[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:23 dist-test-slave-1x4g krb5kdc[9734](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:23 dist-test-slave-1x4g krb5kdc[9734](info): set up 2 sockets
Aug 11 10:02:23 dist-test-slave-1x4g krb5kdc[9734](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 10:02:24.596999 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:24 dist-test-slave-1x4g krb5kdc[9734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:24.719813 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:46221
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:46221
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:24.807137 9752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:24.807374 9752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:24.807426 9752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:24.808578 9752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:24.808638 9752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:24.808661 9752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:24.808688 9752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:24.808722 9752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:24.810618 9752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:46221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:46221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:24.811028 9752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:24.811311 9752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:24.817870 9757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:24.817884 9752 server_base.cc:1034] running on GCE node
W20260811 10:02:24.819021 9763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:24.819250 9760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:24.819605 9752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:24.819962 9752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:24.821127 9752 hybrid_clock.cc:648] HybridClock initialized: now 1786442544821103 us; error 49 us; skew 500 ppm
Aug 11 10:02:24 dist-test-slave-1x4g krb5kdc[9734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442544, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:24.823969 9752 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:24.824618 9752 webserver.cc:460] Webserver started at http://127.9.127.254:38163/ using document root <none> and password file <none>
I20260811 10:02:24.824946 9752 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:24.825032 9752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:24.825220 9752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:24.826922 9752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "f43e378ffa644358b107968597566302"
format_stamp: "Formatted at 2026-08-11 10:02:24 on dist-test-slave-1x4g"
server_key: "c577690e62c476d7f9662f22dc1bbd10"
server_key_iv: "951177277d8e1c9a70887257a77978bf"
server_key_version: "encryptionkey@0"
I20260811 10:02:24.827865 9752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "f43e378ffa644358b107968597566302"
format_stamp: "Formatted at 2026-08-11 10:02:24 on dist-test-slave-1x4g"
server_key: "c577690e62c476d7f9662f22dc1bbd10"
server_key_iv: "951177277d8e1c9a70887257a77978bf"
server_key_version: "encryptionkey@0"
I20260811 10:02:24.830920 9752 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 10:02:24.832767 9770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:24.833083 9752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:24.833192 9752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "f43e378ffa644358b107968597566302"
format_stamp: "Formatted at 2026-08-11 10:02:24 on dist-test-slave-1x4g"
server_key: "c577690e62c476d7f9662f22dc1bbd10"
server_key_iv: "951177277d8e1c9a70887257a77978bf"
server_key_version: "encryptionkey@0"
I20260811 10:02:24.833310 9752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:24.846503 9752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:24.848887 9752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:24.849105 9752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:24.860903 9752 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:46221
I20260811 10:02:24.861056 9829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:46221 every 8 connection(s)
I20260811 10:02:24.861702 9752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:24.863123 9831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:24.865134 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 9752
I20260811 10:02:24.865219 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:24.865953 9727 external_mini_cluster.cc:1428] Setting key ef5d432448ee5cfdd34c0508f631973a
I20260811 10:02:24.868017 9831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302: Bootstrap starting.
I20260811 10:02:24.869549 9831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:24.870290 9831 log.cc:824] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:24.871181 9831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302: No bootstrap required, opened a new log
I20260811 10:02:24.875203 9831 raft_consensus.cc:348] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e378ffa644358b107968597566302" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 46221 } }
I20260811 10:02:24.875434 9831 raft_consensus.cc:374] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:24.875548 9831 raft_consensus.cc:729] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f43e378ffa644358b107968597566302, State: Initialized, Role: FOLLOWER
I20260811 10:02:24.875771 9831 consensus_queue.cc:260] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e378ffa644358b107968597566302" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 46221 } }
I20260811 10:02:24.875967 9831 raft_consensus.cc:388] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:24.876009 9831 raft_consensus.cc:482] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:24.876055 9831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:24.877154 9831 raft_consensus.cc:504] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e378ffa644358b107968597566302" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 46221 } }
I20260811 10:02:24.877388 9831 leader_election.cc:302] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f43e378ffa644358b107968597566302; no voters:
I20260811 10:02:24.877647 9831 leader_election.cc:288] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:24.877719 9836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:24.878007 9836 raft_consensus.cc:686] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [term 1 LEADER]: Becoming Leader. State: Replica: f43e378ffa644358b107968597566302, State: Running, Role: LEADER
I20260811 10:02:24.878218 9836 consensus_queue.cc:237] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e378ffa644358b107968597566302" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 46221 } }
I20260811 10:02:24.878240 9831 sys_catalog.cc:564] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:24.878949 9838 sys_catalog.cc:455] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f43e378ffa644358b107968597566302" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e378ffa644358b107968597566302" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 46221 } } }
I20260811 10:02:24.879046 9838 sys_catalog.cc:458] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:24.879858 9839 sys_catalog.cc:455] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f43e378ffa644358b107968597566302. Latest consensus state: current_term: 1 leader_uuid: "f43e378ffa644358b107968597566302" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43e378ffa644358b107968597566302" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 46221 } } }
I20260811 10:02:24.879993 9839 sys_catalog.cc:458] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:24.880396 9844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:24.882045 9844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 10:02:24 dist-test-slave-1x4g krb5kdc[9734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:24.886124 9844 catalog_manager.cc:1347] Generated new cluster ID: 041809c92b394100b78c003fade20b8e
I20260811 10:02:24.886184 9844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:24.891790 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:24.867326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50844 (local address 127.9.127.254:46221)
0811 10:02:24.867693 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:24.867705 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:24.868000 (+ 295us) server_negotiation.cc:407] Connection header received
0811 10:02:24.871821 (+ 3821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:24.871828 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:24.871916 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:24.872062 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:24.874092 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:24.875569 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:24.877726 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:24.878555 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:24.884037 (+ 5482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:24.885828 (+ 1791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:24.885832 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:24.885832 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:24.885852 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:24.888847 (+ 2995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:24.889464 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:24.889467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:24.889468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:24.889610 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:24.889910 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:24.889911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:24.889912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:24.890324 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:24.890675 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:24.890843 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 10:02:24.891383 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":116,"threads_started":1}
I20260811 10:02:24.902863 9844 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:24.903745 9844 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:24.913625 9844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f43e378ffa644358b107968597566302: Generated new TSK 0
I20260811 10:02:24.913815 9844 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:24.948084 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:46221
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:25.052168 9864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:25.052376 9864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:25.052402 9864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:25.053820 9864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:25.053869 9864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:25.053897 9864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:25.055569 9864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:46221
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:25.055907 9864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:25.056174 9864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:25.063177 9875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:25.063148 9870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:25.063382 9871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:25.063525 9864 server_base.cc:1034] running on GCE node
I20260811 10:02:25.063743 9864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:25.064002 9864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:25.065201 9864 hybrid_clock.cc:648] HybridClock initialized: now 1786442545065194 us; error 36 us; skew 500 ppm
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:25.068367 9864 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:25.068902 9864 webserver.cc:460] Webserver started at http://127.9.127.193:34819/ using document root <none> and password file <none>
I20260811 10:02:25.069149 9864 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:25.069216 9864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:25.069370 9864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:25.070438 9864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "cc3b3bfd9c4941999f9fa85e467ca457"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "09ad7760b773fed0e33a46d0e39c2c8d"
server_key_iv: "b746fbaa743979c2de0744da726dab5f"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.070829 9864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "cc3b3bfd9c4941999f9fa85e467ca457"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "09ad7760b773fed0e33a46d0e39c2c8d"
server_key_iv: "b746fbaa743979c2de0744da726dab5f"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.072409 9864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:25.073246 9883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.073451 9864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 10:02:25.073541 9864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "cc3b3bfd9c4941999f9fa85e467ca457"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "09ad7760b773fed0e33a46d0e39c2c8d"
server_key_iv: "b746fbaa743979c2de0744da726dab5f"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.073601 9864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:25.101529 9864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:25.103953 9864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:25.104151 9864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:25.104542 9864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:25.105028 9864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:25.105108 9864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.105134 9864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:25.105146 9864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.122499 9864 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:34895
I20260811 10:02:25.122706 10015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:34895 every 8 connection(s)
I20260811 10:02:25.122999 9864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:25.124053 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 9864
I20260811 10:02:25.124150 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:25.124357 9727 external_mini_cluster.cc:1428] Setting key 23875d4a9d59d4fac9106cfac9b606a7
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
I20260811 10:02:25.136551 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:25.124063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:40105 (local address 127.9.127.254:46221)
0811 10:02:25.124157 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:25.124160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:25.124497 (+ 337us) server_negotiation.cc:407] Connection header received
0811 10:02:25.125501 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:25.125502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:25.125511 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:25.125561 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:25.127472 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.128328 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.129591 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.129950 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.130039 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:25.132959 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:25.132960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:25.132961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:25.132969 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:25.134889 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.135348 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.135349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.135350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.135415 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.135700 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.135702 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.135702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.135878 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:25.135992 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:25.136304 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 10:02:25.136422 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 10:02:25.136663 10019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:25.124022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:46221 (local address 127.9.127.193:40105)
0811 10:02:25.124342 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:25.124395 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:25.125382 (+ 987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:25.125639 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:25.125643 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:25.126772 (+ 1129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:25.127342 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:25.127360 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.128447 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.128448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:25.129505 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:25.129508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.130044 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.130044 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:25.130147 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:25.130848 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:25.130856 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:25.132771 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:25.135009 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:25.135016 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:25.135018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:25.135247 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:25.135500 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:25.135501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:25.135501 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:25.135599 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:25.135993 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:25.135999 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:25.136126 (+ 127us) client_negotiation.cc:769] Sending connection context
0811 10:02:25.136266 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 10:02:25.136426 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":146,"threads_started":1}
I20260811 10:02:25.137511 10016 heartbeater.cc:347] Connected to a master server at 127.9.127.254:46221
I20260811 10:02:25.137636 10016 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:25.137832 10016 heartbeater.cc:511] Master 127.9.127.254:46221 requested a full tablet report, sending...
I20260811 10:02:25.138803 9790 ts_manager.cc:194] Registered new tserver with Master: cc3b3bfd9c4941999f9fa85e467ca457 (127.9.127.193:34895)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
I20260811 10:02:25.139746 9790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:40105
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:25.155926 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:46221
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:25.284492 10025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:25.284691 10025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:25.284714 10025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:25.285902 10025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:25.285950 10025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:25.285975 10025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:25.287490 10025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:46221
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:25.287678 10025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:25.287850 10025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:25.293239 10033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:25.293251 10035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:25.293229 10031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:25.293550 10025 server_base.cc:1034] running on GCE node
I20260811 10:02:25.293767 10025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:25.294010 10025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:25.295161 10025 hybrid_clock.cc:648] HybridClock initialized: now 1786442545295145 us; error 36 us; skew 500 ppm
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:25.297871 10025 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:25.298373 10025 webserver.cc:460] Webserver started at http://127.9.127.194:46691/ using document root <none> and password file <none>
I20260811 10:02:25.298570 10025 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:25.298612 10025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:25.298695 10025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:25.299670 10025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "db518649e8ce4e6eb3a68bcce838c44d"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "80d22c687cfbac1e57f59e4e465a5ae3"
server_key_iv: "caf48941772b81b6c047f708ae49286f"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.300107 10025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "db518649e8ce4e6eb3a68bcce838c44d"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "80d22c687cfbac1e57f59e4e465a5ae3"
server_key_iv: "caf48941772b81b6c047f708ae49286f"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.301499 10025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:02:25.302290 10043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.302492 10025 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 10:02:25.302577 10025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "db518649e8ce4e6eb3a68bcce838c44d"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "80d22c687cfbac1e57f59e4e465a5ae3"
server_key_iv: "caf48941772b81b6c047f708ae49286f"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.302630 10025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:25.309907 10025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:25.312088 10025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:25.312192 10025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:25.312357 10025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:25.312659 10025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:25.312693 10025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.312731 10025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:25.312757 10025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.329025 10025 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:43267
I20260811 10:02:25.329110 10174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:43267 every 8 connection(s)
I20260811 10:02:25.329476 10025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:25.337239 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 10025
I20260811 10:02:25.337363 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:25.337508 9727 external_mini_cluster.cc:1428] Setting key aaf8064256d186347ddfb4646c7070c9
I20260811 10:02:25.341022 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:25.330391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:53491 (local address 127.9.127.254:46221)
0811 10:02:25.330457 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:25.330459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:25.330816 (+ 357us) server_negotiation.cc:407] Connection header received
0811 10:02:25.331703 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:25.331705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:25.331719 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:25.331772 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:25.333129 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.333638 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.334800 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.334994 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.335093 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:25.337700 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:25.337701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:25.337702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:25.337709 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:25.339295 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.339895 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.339896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.339896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.339948 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.340250 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.340251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.340251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.340404 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:25.340506 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:25.340809 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 10:02:25.340903 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 10:02:25.341140 10177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:25.330364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:46221 (local address 127.9.127.194:53491)
0811 10:02:25.330679 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:25.330716 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:25.331579 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:25.331858 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:25.331862 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:25.332637 (+ 775us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:25.333029 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:25.333035 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.333744 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.333745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:25.334697 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:25.334699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.335120 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.335121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:25.335296 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:25.335831 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:25.335840 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:25.337604 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:25.339387 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:25.339394 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:25.339397 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:25.339794 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:25.340022 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:25.340023 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:25.340023 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:25.340181 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:25.340496 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:25.340504 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:25.340650 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 10:02:25.340737 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 10:02:25.340915 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":187,"threads_started":1}
I20260811 10:02:25.341621 10175 heartbeater.cc:347] Connected to a master server at 127.9.127.254:46221
I20260811 10:02:25.341715 10175 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:25.341899 10175 heartbeater.cc:511] Master 127.9.127.254:46221 requested a full tablet report, sending...
I20260811 10:02:25.342315 9790 ts_manager.cc:194] Registered new tserver with Master: db518649e8ce4e6eb3a68bcce838c44d (127.9.127.194:43267)
I20260811 10:02:25.342703 9790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:53491
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:25.367247 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:46221
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:25.482498 10182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:25.482692 10182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:25.482715 10182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:25.483829 10182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:25.483867 10182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:25.483892 10182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:25.485230 10182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:46221
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:25.485428 10182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:25.485595 10182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:25.491161 10189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:25.491199 10192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:25.491432 10182 server_base.cc:1034] running on GCE node
W20260811 10:02:25.491456 10190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:25.491726 10182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:25.491979 10182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:25.493131 10182 hybrid_clock.cc:648] HybridClock initialized: now 1786442545493111 us; error 33 us; skew 500 ppm
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:25.495510 10182 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:25.495940 10182 webserver.cc:460] Webserver started at http://127.9.127.195:37847/ using document root <none> and password file <none>
I20260811 10:02:25.496170 10182 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:25.496235 10182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:25.496380 10182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:25.497540 10182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "90f38ca93a2e47e38ada535f33ea0c92"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "f43a714a45cd89d0470217f0b1f061b5"
server_key_iv: "795b81bcc1b787b7585e1b7478582856"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.497975 10182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "90f38ca93a2e47e38ada535f33ea0c92"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "f43a714a45cd89d0470217f0b1f061b5"
server_key_iv: "795b81bcc1b787b7585e1b7478582856"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.499603 10182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:02:25.500298 10199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.500460 10182 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:25.500571 10182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "90f38ca93a2e47e38ada535f33ea0c92"
format_stamp: "Formatted at 2026-08-11 10:02:25 on dist-test-slave-1x4g"
server_key: "f43a714a45cd89d0470217f0b1f061b5"
server_key_iv: "795b81bcc1b787b7585e1b7478582856"
server_key_version: "encryptionkey@0"
I20260811 10:02:25.500638 10182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:25.519276 10182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:25.521129 10182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:25.521281 10182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:25.521498 10182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:25.521852 10182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:25.521906 10182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.521947 10182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:25.521997 10182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:25.532483 10182 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:32865
I20260811 10:02:25.532521 10330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:32865 every 8 connection(s)
I20260811 10:02:25.532896 10182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:25.534435 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 10182
I20260811 10:02:25.534531 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:25.534726 9727 external_mini_cluster.cc:1428] Setting key de105b606fe7a3fa6d283dda9bda4b9f
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:25.542781 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:25.533689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:46385 (local address 127.9.127.254:46221)
0811 10:02:25.533775 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:25.533778 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:25.534072 (+ 294us) server_negotiation.cc:407] Connection header received
0811 10:02:25.534624 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:25.534626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:25.534641 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:25.534729 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:25.535891 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.536595 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.537968 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.538172 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.538236 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:25.540372 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:25.540373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:25.540373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:25.540380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:25.541632 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.542007 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.542008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.542008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.542059 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.542267 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.542267 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.542268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.542375 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:25.542430 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:25.542652 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 10:02:25.542715 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 10:02:25.542932 10333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:25.533653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:46221 (local address 127.9.127.195:46385)
0811 10:02:25.533917 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:25.533953 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:25.534494 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:25.534781 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:25.534785 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:25.535477 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:25.535766 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:25.535815 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.536683 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.536684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:25.537881 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:25.537885 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.538253 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.538254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:25.538354 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:25.538893 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:25.538902 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:25.540286 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:25.541700 (+ 1414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:25.541707 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:25.541709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:25.541937 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:25.542113 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:25.542114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:25.542114 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:25.542212 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:25.542429 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:25.542433 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:25.542544 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 10:02:25.542626 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 10:02:25.542741 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":190,"threads_started":1}
I20260811 10:02:25.543380 10331 heartbeater.cc:347] Connected to a master server at 127.9.127.254:46221
I20260811 10:02:25.543469 10331 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:25.543612 10331 heartbeater.cc:511] Master 127.9.127.254:46221 requested a full tablet report, sending...
I20260811 10:02:25.543999 9790 ts_manager.cc:194] Registered new tserver with Master: 90f38ca93a2e47e38ada535f33ea0c92 (127.9.127.195:32865)
I20260811 10:02:25.544334 9790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:46385
I20260811 10:02:25.546980 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:25.571628 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:25.564448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56230 (local address 127.9.127.193:34895)
0811 10:02:25.564612 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:25.564618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:25.564633 (+ 15us) server_negotiation.cc:407] Connection header received
0811 10:02:25.564679 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:25.564681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:25.564695 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:25.564756 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:25.565319 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.566029 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.566686 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.567004 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.567058 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:25.569209 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:25.569218 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:25.569218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:25.569224 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:25.570616 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.570944 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.570948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.570949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.571008 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.571167 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.571168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.571168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.571297 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:25.571421 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:25.571466 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 10:02:25.571529 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
W20260811 10:02:25.572088 9912 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56230
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[9734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:25.595892 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:25.589206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56236 (local address 127.9.127.193:34895)
0811 10:02:25.589273 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:25.589276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:25.589374 (+ 98us) server_negotiation.cc:407] Connection header received
0811 10:02:25.589485 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:25.589486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:25.589498 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:25.589554 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:25.590140 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.590647 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.591365 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:25.591576 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:25.591648 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:25.593839 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:25.593840 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:25.593841 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:25.593847 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:25.594985 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.595335 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.595335 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.595336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.595382 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:25.595532 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:25.595533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:25.595533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:25.595621 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:25.595706 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:25.595771 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 10:02:25.595830 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:02:25.596393 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 9864
I20260811 10:02:25.603261 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 10025
I20260811 10:02:25.611788 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 10182
I20260811 10:02:25.620162 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 9752
2026-08-11T10:02:25Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2154 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[10348](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[10348](info): set up 2 sockets
Aug 11 10:02:25 dist-test-slave-1x4g krb5kdc[10348](info): commencing operation
krb5kdc: starting...
W20260811 10:02:26.700266 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:26 dist-test-slave-1x4g krb5kdc[10348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:26.817906 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33379
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:33379
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:26.909025 10362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:26.909248 10362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:26.909286 10362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:26.910444 10362 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:26.910507 10362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:26.910534 10362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:26.910564 10362 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:26.910586 10362 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:26.912056 10362 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:33379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:26.912328 10362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:26.912533 10362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:26.917338 10373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:26.917323 10370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:26.917309 10369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:26.917578 10362 server_base.cc:1034] running on GCE node
I20260811 10:02:26.917824 10362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:26.918156 10362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:26.919306 10362 hybrid_clock.cc:648] HybridClock initialized: now 1786442546919292 us; error 32 us; skew 500 ppm
Aug 11 10:02:26 dist-test-slave-1x4g krb5kdc[10348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442546, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:26.921741 10362 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:26.922217 10362 webserver.cc:460] Webserver started at http://127.9.127.254:34751/ using document root <none> and password file <none>
I20260811 10:02:26.922448 10362 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:26.922493 10362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:26.922657 10362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:26.923681 10362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "5249de51ed8c45f3b47d2c781c110aae"
format_stamp: "Formatted at 2026-08-11 10:02:26 on dist-test-slave-1x4g"
server_key: "9ebad27fdf3a10662b2e7249840e3843"
server_key_iv: "ef7143d5a25bed59868468654089be3f"
server_key_version: "encryptionkey@0"
I20260811 10:02:26.924045 10362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "5249de51ed8c45f3b47d2c781c110aae"
format_stamp: "Formatted at 2026-08-11 10:02:26 on dist-test-slave-1x4g"
server_key: "9ebad27fdf3a10662b2e7249840e3843"
server_key_iv: "ef7143d5a25bed59868468654089be3f"
server_key_version: "encryptionkey@0"
I20260811 10:02:26.925467 10362 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:26.926247 10381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:26.926420 10362 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:26.926519 10362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "5249de51ed8c45f3b47d2c781c110aae"
format_stamp: "Formatted at 2026-08-11 10:02:26 on dist-test-slave-1x4g"
server_key: "9ebad27fdf3a10662b2e7249840e3843"
server_key_iv: "ef7143d5a25bed59868468654089be3f"
server_key_version: "encryptionkey@0"
I20260811 10:02:26.926587 10362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:26.943681 10362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:26.945426 10362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:26.945578 10362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:26.949776 10362 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:33379
I20260811 10:02:26.949823 10446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:33379 every 8 connection(s)
I20260811 10:02:26.950201 10362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:26.951069 10447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:26.952303 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 10362
I20260811 10:02:26.952443 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:26.952631 9727 external_mini_cluster.cc:1428] Setting key b490f855f5103a4c01045863ae241269
I20260811 10:02:26.953827 10447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae: Bootstrap starting.
I20260811 10:02:26.954447 10447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:26.954747 10447 log.cc:824] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:26.955479 10447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae: No bootstrap required, opened a new log
I20260811 10:02:26.957405 10447 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5249de51ed8c45f3b47d2c781c110aae" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33379 } }
I20260811 10:02:26.957589 10447 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:26.957648 10447 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5249de51ed8c45f3b47d2c781c110aae, State: Initialized, Role: FOLLOWER
I20260811 10:02:26.957788 10447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5249de51ed8c45f3b47d2c781c110aae" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33379 } }
I20260811 10:02:26.957855 10447 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:26.957880 10447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:26.957934 10447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:26.958420 10447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5249de51ed8c45f3b47d2c781c110aae" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33379 } }
I20260811 10:02:26.958524 10447 leader_election.cc:302] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5249de51ed8c45f3b47d2c781c110aae; no voters:
I20260811 10:02:26.958711 10447 leader_election.cc:288] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:26.958771 10452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:26.958932 10452 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [term 1 LEADER]: Becoming Leader. State: Replica: 5249de51ed8c45f3b47d2c781c110aae, State: Running, Role: LEADER
I20260811 10:02:26.958999 10447 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:26.959017 10452 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5249de51ed8c45f3b47d2c781c110aae" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33379 } }
Aug 11 10:02:26 dist-test-slave-1x4g krb5kdc[10348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:26.959335 10452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5249de51ed8c45f3b47d2c781c110aae. Latest consensus state: current_term: 1 leader_uuid: "5249de51ed8c45f3b47d2c781c110aae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5249de51ed8c45f3b47d2c781c110aae" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33379 } } }
I20260811 10:02:26.959401 10452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:26.959648 10453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5249de51ed8c45f3b47d2c781c110aae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5249de51ed8c45f3b47d2c781c110aae" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33379 } } }
I20260811 10:02:26.959782 10453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:26.960348 10456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:26.960901 10456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:26.962589 10456 catalog_manager.cc:1347] Generated new cluster ID: 727edd2bc4f441e0b97aa7ad076987ee
I20260811 10:02:26.962646 10456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:26.964174 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:26.953159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48268 (local address 127.9.127.254:33379)
0811 10:02:26.953361 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:26.953370 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:26.953402 (+ 32us) server_negotiation.cc:407] Connection header received
0811 10:02:26.953843 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:26.953849 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:26.953917 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:26.954059 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:26.954698 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:26.955842 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:26.956577 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:26.957064 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:26.957188 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:26.959861 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:26.959866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:26.959866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:26.959880 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:26.962434 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:26.962936 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:26.962940 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:26.962940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:26.963058 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:26.963290 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:26.963291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:26.963291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:26.963539 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:26.963679 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:26.963855 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 10:02:26.963997 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":106,"threads_started":1}
I20260811 10:02:26.977257 10456 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:26.977764 10456 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:26.984117 10456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5249de51ed8c45f3b47d2c781c110aae: Generated new TSK 0
I20260811 10:02:26.984285 10456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:27.019204 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33379
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:27.124104 10476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:27.124351 10476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:27.124377 10476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:27.125509 10476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:27.125545 10476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:27.125571 10476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:27.127004 10476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33379
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:27.127199 10476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:27.127355 10476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:27.132197 10485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:27.132201 10482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:27.132201 10483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:27.132427 10476 server_base.cc:1034] running on GCE node
I20260811 10:02:27.132611 10476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:27.132884 10476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:27.134037 10476 hybrid_clock.cc:648] HybridClock initialized: now 1786442547134026 us; error 37 us; skew 500 ppm
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:27.136396 10476 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:27.136859 10476 webserver.cc:460] Webserver started at http://127.9.127.193:37523/ using document root <none> and password file <none>
I20260811 10:02:27.137089 10476 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:27.137153 10476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:27.137285 10476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:27.138271 10476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "f1923bdcbad64c329f16cf671b7e42ca"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "15fe286e6f02cd719570340989568614"
server_key_iv: "eb031d3cb472ddab85a874d3349ee567"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.138633 10476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "f1923bdcbad64c329f16cf671b7e42ca"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "15fe286e6f02cd719570340989568614"
server_key_iv: "eb031d3cb472ddab85a874d3349ee567"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.139925 10476 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:27.140616 10492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.140811 10476 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:27.140903 10476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "f1923bdcbad64c329f16cf671b7e42ca"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "15fe286e6f02cd719570340989568614"
server_key_iv: "eb031d3cb472ddab85a874d3349ee567"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.140991 10476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:27.161278 10476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:27.163045 10476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:27.163223 10476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:27.163481 10476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:27.163786 10476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:27.163837 10476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.163877 10476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:27.163909 10476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.169960 10476 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:34263
I20260811 10:02:27.170003 10623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:34263 every 8 connection(s)
I20260811 10:02:27.170347 10476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:27.174917 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 10476
I20260811 10:02:27.174996 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:27.175176 9727 external_mini_cluster.cc:1428] Setting key 3fd402444528e75bbf5a1e23a37cac3e
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:27.180747 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.171062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:41019 (local address 127.9.127.254:33379)
0811 10:02:27.171107 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.171110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.171287 (+ 177us) server_negotiation.cc:407] Connection header received
0811 10:02:27.172342 (+ 1055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.172343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.172357 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.172409 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:27.173040 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.173547 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.174902 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.175419 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.175490 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.177926 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:27.177927 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:27.177928 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:27.177936 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:27.179346 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.179774 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.179775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.179775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.179836 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.180078 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.180079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.180079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.180200 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:27.180276 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.180542 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.180656 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:02:27.180929 10626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.171024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33379 (local address 127.9.127.193:41019)
0811 10:02:27.171167 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:27.171208 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:27.172227 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:27.172476 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:27.172480 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:27.172724 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:27.172943 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.172948 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.173639 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.173640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.174781 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.174784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.175510 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.175512 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.175634 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.176226 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:27.176237 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:27.177826 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:27.179448 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:27.179456 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:27.179458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:27.179688 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:27.179905 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:27.179906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:27.179906 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:27.180014 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:27.180267 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:27.180274 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:27.180413 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 10:02:27.180518 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 10:02:27.180675 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260811 10:02:27.181418 10624 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33379
I20260811 10:02:27.181519 10624 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:27.181712 10624 heartbeater.cc:511] Master 127.9.127.254:33379 requested a full tablet report, sending...
I20260811 10:02:27.182318 10400 ts_manager.cc:194] Registered new tserver with Master: f1923bdcbad64c329f16cf671b7e42ca (127.9.127.193:34263)
I20260811 10:02:27.183323 10400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:41019
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:27.203212 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33379
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:27.286731 10629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:27.286926 10629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:27.286947 10629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:27.288276 10629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:27.288328 10629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:27.288357 10629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:27.290354 10629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33379
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:27.290632 10629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:27.290885 10629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:27.296175 10636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:27.296273 10629 server_base.cc:1034] running on GCE node
W20260811 10:02:27.296324 10634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:27.296195 10638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:27.296660 10629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:27.296984 10629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:27.298153 10629 hybrid_clock.cc:648] HybridClock initialized: now 1786442547298133 us; error 38 us; skew 500 ppm
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:27.300637 10629 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:27.301172 10629 webserver.cc:460] Webserver started at http://127.9.127.194:43109/ using document root <none> and password file <none>
I20260811 10:02:27.301399 10629 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:27.301467 10629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:27.301725 10629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:27.302778 10629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "6af602be79d845efba86055722e92e9b"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "dcb16c652888fd4b28cc89bfd031b9e5"
server_key_iv: "baec1681fc0ef327df5729b9307f25ce"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.303146 10629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "6af602be79d845efba86055722e92e9b"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "dcb16c652888fd4b28cc89bfd031b9e5"
server_key_iv: "baec1681fc0ef327df5729b9307f25ce"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.304535 10629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:27.305512 10645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.305682 10629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:27.305789 10629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "6af602be79d845efba86055722e92e9b"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "dcb16c652888fd4b28cc89bfd031b9e5"
server_key_iv: "baec1681fc0ef327df5729b9307f25ce"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.305879 10629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:27.326457 10629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:27.328362 10629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:27.328701 10629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:27.328980 10629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:27.329345 10629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:27.329382 10629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.329404 10629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:27.329421 10629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.335510 10629 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:36131
I20260811 10:02:27.335570 10780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:36131 every 8 connection(s)
I20260811 10:02:27.335857 10629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:27.338281 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 10629
I20260811 10:02:27.338389 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:27.338564 9727 external_mini_cluster.cc:1428] Setting key f69b464f02a2d76102e6a395fa1b93cf
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:27.346369 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.336607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:49491 (local address 127.9.127.254:33379)
0811 10:02:27.336663 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.336665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.336906 (+ 241us) server_negotiation.cc:407] Connection header received
0811 10:02:27.337816 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.337817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.337827 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.337878 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:27.338487 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.339188 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.340209 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.340521 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.340598 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.343176 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:27.343177 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:27.343178 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:27.343184 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:27.344696 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.345242 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.345244 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.345244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.345305 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.345663 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.345665 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.345665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.345780 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:27.345836 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.346211 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.346287 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:02:27.346626 10783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.336577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33379 (local address 127.9.127.194:49491)
0811 10:02:27.336740 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:27.336812 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:27.337728 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:27.337932 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:27.337934 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:27.338194 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:27.338376 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.338404 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.339293 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.339294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.340120 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.340122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.340608 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.340609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.340719 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.341327 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:27.341338 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:27.343073 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:27.344807 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:27.344815 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:27.344817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:27.345134 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:27.345385 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:27.345386 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:27.345387 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:27.345559 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:27.345852 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:27.345859 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:27.346029 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 10:02:27.346143 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 10:02:27.346343 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":102,"threads_started":1}
I20260811 10:02:27.347146 10781 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33379
I20260811 10:02:27.347242 10781 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:27.347438 10781 heartbeater.cc:511] Master 127.9.127.254:33379 requested a full tablet report, sending...
I20260811 10:02:27.347811 10400 ts_manager.cc:194] Registered new tserver with Master: 6af602be79d845efba86055722e92e9b (127.9.127.194:36131)
I20260811 10:02:27.348220 10400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:49491
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:27.367350 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33379
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:27.448601 10786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:27.448829 10786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:27.448864 10786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:27.450045 10786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:27.450086 10786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:27.450112 10786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:27.451503 10786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33379
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:27.451723 10786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:27.451918 10786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:27.456503 10791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:27.456522 10792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:27.456512 10794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:27.456873 10786 server_base.cc:1034] running on GCE node
I20260811 10:02:27.457054 10786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:27.457227 10786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:27.458372 10786 hybrid_clock.cc:648] HybridClock initialized: now 1786442547458356 us; error 25 us; skew 500 ppm
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:27.461277 10786 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:27.461690 10786 webserver.cc:460] Webserver started at http://127.9.127.195:37513/ using document root <none> and password file <none>
I20260811 10:02:27.461939 10786 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:27.462041 10786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:27.462215 10786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:27.463215 10786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "5b58464f8837e2b3c089cf345b7afbb9"
server_key_iv: "f9f945379d41d4c9ad3e8689951c7e90"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.463600 10786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "5b58464f8837e2b3c089cf345b7afbb9"
server_key_iv: "f9f945379d41d4c9ad3e8689951c7e90"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.464972 10786 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:02:27.465651 10801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.465811 10786 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:27.465905 10786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2"
format_stamp: "Formatted at 2026-08-11 10:02:27 on dist-test-slave-1x4g"
server_key: "5b58464f8837e2b3c089cf345b7afbb9"
server_key_iv: "f9f945379d41d4c9ad3e8689951c7e90"
server_key_version: "encryptionkey@0"
I20260811 10:02:27.466001 10786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:27.474761 10786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:27.476508 10786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:27.476673 10786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:27.476930 10786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:27.477223 10786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:27.477276 10786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.477314 10786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:27.477344 10786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:27.483651 10786 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:34617
I20260811 10:02:27.483717 10930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:34617 every 8 connection(s)
I20260811 10:02:27.484025 10786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:27.492314 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 10786
I20260811 10:02:27.492449 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:27.492609 9727 external_mini_cluster.cc:1428] Setting key 71726c65a21dc899eaa3e51e7150d193
I20260811 10:02:27.492884 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.484763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:34201 (local address 127.9.127.254:33379)
0811 10:02:27.484838 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.484840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.485055 (+ 215us) server_negotiation.cc:407] Connection header received
0811 10:02:27.485953 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.485955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.485968 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.486018 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:27.486591 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.487088 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.488042 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.488238 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.488318 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.490313 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:27.490314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:27.490315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:27.490322 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:27.491475 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.491867 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.491868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.491869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.491922 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.492191 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.492192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.492192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.492302 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:27.492375 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.492690 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.492818 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 10:02:27.493085 10933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.484732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33379 (local address 127.9.127.195:34201)
0811 10:02:27.484892 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:27.484947 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:27.485842 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:27.486080 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:27.486085 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:27.486319 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:27.486492 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.486495 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.487187 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.487188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.487949 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.487951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.488331 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.488332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.488450 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.488889 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:27.488897 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:27.490217 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:27.491581 (+ 1364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:27.491588 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:27.491590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:27.491788 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:27.492003 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:27.492003 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:27.492004 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:27.492105 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:27.492379 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:27.492386 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:27.492536 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 10:02:27.492645 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 10:02:27.492842 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260811 10:02:27.493554 10931 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33379
I20260811 10:02:27.493640 10931 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:27.493793 10931 heartbeater.cc:511] Master 127.9.127.254:33379 requested a full tablet report, sending...
I20260811 10:02:27.494131 10400 ts_manager.cc:194] Registered new tserver with Master: 5f7ce4e578c24f28aafbbee94b1b3ce2 (127.9.127.195:34617)
I20260811 10:02:27.494464 10400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:34201
I20260811 10:02:27.504207 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:02:27.512084 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.506351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48284 (local address 127.9.127.254:33379)
0811 10:02:27.506414 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.506416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.506425 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:27.506448 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.506449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.506466 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.506526 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:27.507045 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.507498 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.508158 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.508331 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.508388 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.509604 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:27.509605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:27.509606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:27.509612 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:27.511153 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.511450 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.511450 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.511451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.511506 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.511666 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.511667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.511667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.511799 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:27.511908 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.511966 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.512028 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:02:27.514885 10400 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48284:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:27.516616 10400 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:27.524420 10943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.519859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:36131 (local address 127.0.0.1:53754)
0811 10:02:27.519985 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:27.520028 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:27.520118 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:27.520678 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:27.520682 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:27.520696 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:27.520763 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.520766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.522315 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.522316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.523375 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.523377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.524108 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.524109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.524186 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.524199 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 10:02:27.524296 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 10:02:27.524349 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":54,"threads_started":1}
I20260811 10:02:27.524430 10947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.520112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53754 (local address 127.9.127.194:36131)
0811 10:02:27.520509 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.520512 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.520528 (+ 16us) server_negotiation.cc:407] Connection header received
0811 10:02:27.520561 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.520563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.520576 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.520670 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:27.520961 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.522182 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.523454 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.524010 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.524106 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.524167 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.524315 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.524356 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":82,"threads_started":1}
I20260811 10:02:27.524552 10946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.519858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:34263 (local address 127.0.0.1:59256)
0811 10:02:27.520268 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:27.520279 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:27.520325 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:27.520719 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:27.520720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:27.520723 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:27.520812 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.520815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.521966 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.521967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.523357 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.523360 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.524326 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.524327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.524397 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.524401 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:27.524432 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 10:02:27.524477 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":2,"thread_start_us":87,"threads_started":1}
I20260811 10:02:27.524717 10945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.520082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:34617 (local address 127.0.0.1:43698)
0811 10:02:27.520814 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:27.520824 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:27.520872 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:27.521244 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:27.521245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:27.521247 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:27.521293 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.521294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.522570 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.522571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.523579 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.523582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.524480 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.524481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.524531 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.524535 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:27.524594 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 10:02:27.524636 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":79,"threads_started":1}
I20260811 10:02:27.524966 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.520258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59256 (local address 127.9.127.193:34263)
0811 10:02:27.520500 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.520504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.520513 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:27.520550 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.520570 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.520588 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.520715 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:27.520918 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.521826 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.523492 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.524216 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.524720 (+ 504us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.524820 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.524847 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.524892 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":99,"threads_started":1}
I20260811 10:02:27.525008 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.520229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43698 (local address 127.9.127.195:34617)
0811 10:02:27.520433 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.520438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.521004 (+ 566us) server_negotiation.cc:407] Connection header received
0811 10:02:27.521054 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.521057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.521073 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.521152 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:27.521379 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.522467 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.523668 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.524339 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.524397 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.524449 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.524888 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.524928 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":103,"threads_started":1}
I20260811 10:02:27.525432 10706 tablet_service.cc:1467] Processing CreateTablet for tablet 7f99de2b960f4ae2993a1396fd6e97e0 (DEFAULT_TABLE table=test-table [id=7189057f80bf4f8184d60ed830e58c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:27.525588 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 7f99de2b960f4ae2993a1396fd6e97e0 (DEFAULT_TABLE table=test-table [id=7189057f80bf4f8184d60ed830e58c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:27.525578 10547 tablet_service.cc:1467] Processing CreateTablet for tablet 7f99de2b960f4ae2993a1396fd6e97e0 (DEFAULT_TABLE table=test-table [id=7189057f80bf4f8184d60ed830e58c1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:27.525846 10706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f99de2b960f4ae2993a1396fd6e97e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:27.525915 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f99de2b960f4ae2993a1396fd6e97e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:27.525915 10547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f99de2b960f4ae2993a1396fd6e97e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:27.528949 10951 tablet_bootstrap.cc:492] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b: Bootstrap starting.
I20260811 10:02:27.529255 10952 tablet_bootstrap.cc:492] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca: Bootstrap starting.
I20260811 10:02:27.529552 10953 tablet_bootstrap.cc:492] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2: Bootstrap starting.
I20260811 10:02:27.529709 10951 tablet_bootstrap.cc:654] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:27.530094 10952 tablet_bootstrap.cc:654] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:27.530230 10953 tablet_bootstrap.cc:654] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:27.530555 10951 log.cc:824] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:27.530705 10952 log.cc:824] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:27.530911 10953 log.cc:824] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:27.531329 10951 tablet_bootstrap.cc:492] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b: No bootstrap required, opened a new log
I20260811 10:02:27.531391 10952 tablet_bootstrap.cc:492] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca: No bootstrap required, opened a new log
I20260811 10:02:27.531397 10951 ts_tablet_manager.cc:1397] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:02:27.531464 10952 ts_tablet_manager.cc:1397] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:27.531647 10953 tablet_bootstrap.cc:492] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2: No bootstrap required, opened a new log
I20260811 10:02:27.531733 10953 ts_tablet_manager.cc:1397] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:27.532930 10951 raft_consensus.cc:348] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.533077 10951 raft_consensus.cc:374] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:27.533136 10951 raft_consensus.cc:729] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af602be79d845efba86055722e92e9b, State: Initialized, Role: FOLLOWER
I20260811 10:02:27.533245 10951 consensus_queue.cc:260] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.533526 10951 ts_tablet_manager.cc:1428] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:27.533699 10781 heartbeater.cc:503] Master 127.9.127.254:33379 was elected leader, sending a full tablet report...
I20260811 10:02:27.533592 10953 raft_consensus.cc:348] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.533591 10952 raft_consensus.cc:348] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.533764 10953 raft_consensus.cc:374] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:27.533764 10952 raft_consensus.cc:374] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:27.533808 10952 raft_consensus.cc:729] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1923bdcbad64c329f16cf671b7e42ca, State: Initialized, Role: FOLLOWER
I20260811 10:02:27.533808 10953 raft_consensus.cc:729] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7ce4e578c24f28aafbbee94b1b3ce2, State: Initialized, Role: FOLLOWER
I20260811 10:02:27.533946 10952 consensus_queue.cc:260] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.533939 10953 consensus_queue.cc:260] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.534219 10953 ts_tablet_manager.cc:1428] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:02:27.534219 10952 ts_tablet_manager.cc:1428] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:02:27.534335 10624 heartbeater.cc:503] Master 127.9.127.254:33379 was elected leader, sending a full tablet report...
I20260811 10:02:27.534399 10931 heartbeater.cc:503] Master 127.9.127.254:33379 was elected leader, sending a full tablet report...
W20260811 10:02:27.586580 10782 tablet.cc:2369] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:27.617571 10960 raft_consensus.cc:482] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:27.617710 10960 raft_consensus.cc:504] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.618284 10960 leader_election.cc:288] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6af602be79d845efba86055722e92e9b (127.9.127.194:36131), f1923bdcbad64c329f16cf671b7e42ca (127.9.127.193:34263)
I20260811 10:02:27.621236 10933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.618473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:34263 (local address 127.9.127.195:60815)
0811 10:02:27.618524 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:27.618537 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:27.618589 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:27.618757 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:27.618758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:27.618760 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:27.618856 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.618859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.619610 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.619611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.620399 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.620401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.621008 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.621009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.621090 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.621094 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:27.621153 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 10:02:27.621183 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":2}
I20260811 10:02:27.621291 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.618576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:60815 (local address 127.9.127.193:34263)
0811 10:02:27.618623 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.618625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.618632 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:27.618668 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.618669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.618677 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.618748 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:27.618966 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.619530 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.620503 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.620928 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.620983 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.620991 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.621170 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.621213 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 10:02:27.621383 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.618474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:36131 (local address 127.9.127.195:47507)
0811 10:02:27.618752 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:27.618760 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:27.618819 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:27.618964 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:27.618965 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:27.618967 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:27.619036 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.619038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.619711 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.619712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.620470 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:27.620472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.621106 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.621107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:27.621195 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.621203 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 10:02:27.621260 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 10:02:27.621294 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":54,"thread_start_us":169,"threads_started":1}
I20260811 10:02:27.621419 10947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.618571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:47507 (local address 127.9.127.194:36131)
0811 10:02:27.618616 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.618618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.618819 (+ 201us) server_negotiation.cc:407] Connection header received
0811 10:02:27.618877 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.618879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.618889 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.618951 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:27.619140 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.619626 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.620561 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.621020 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.621091 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.621099 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.621289 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.621337 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:02:27.621655 10571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f99de2b960f4ae2993a1396fd6e97e0" candidate_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1923bdcbad64c329f16cf671b7e42ca" is_pre_election: true
I20260811 10:02:27.621722 10728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f99de2b960f4ae2993a1396fd6e97e0" candidate_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af602be79d845efba86055722e92e9b" is_pre_election: true
I20260811 10:02:27.621850 10571 raft_consensus.cc:2454] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7ce4e578c24f28aafbbee94b1b3ce2 in term 0.
I20260811 10:02:27.621862 10728 raft_consensus.cc:2454] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7ce4e578c24f28aafbbee94b1b3ce2 in term 0.
I20260811 10:02:27.622146 10805 leader_election.cc:302] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7ce4e578c24f28aafbbee94b1b3ce2, 6af602be79d845efba86055722e92e9b; no voters:
I20260811 10:02:27.622292 10960 raft_consensus.cc:2781] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:27.622370 10960 raft_consensus.cc:482] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:27.622406 10960 raft_consensus.cc:3037] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:27.623116 10960 raft_consensus.cc:504] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.623266 10960 leader_election.cc:288] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [CANDIDATE]: Term 1 election: Requested vote from peers 6af602be79d845efba86055722e92e9b (127.9.127.194:36131), f1923bdcbad64c329f16cf671b7e42ca (127.9.127.193:34263)
I20260811 10:02:27.623456 10728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f99de2b960f4ae2993a1396fd6e97e0" candidate_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af602be79d845efba86055722e92e9b"
I20260811 10:02:27.623507 10571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f99de2b960f4ae2993a1396fd6e97e0" candidate_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1923bdcbad64c329f16cf671b7e42ca"
I20260811 10:02:27.623549 10728 raft_consensus.cc:3037] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:27.623589 10571 raft_consensus.cc:3037] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:27.624248 10728 raft_consensus.cc:2454] T 7f99de2b960f4ae2993a1396fd6e97e0 P 6af602be79d845efba86055722e92e9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7ce4e578c24f28aafbbee94b1b3ce2 in term 1.
I20260811 10:02:27.624405 10571 raft_consensus.cc:2454] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7ce4e578c24f28aafbbee94b1b3ce2 in term 1.
I20260811 10:02:27.624486 10805 leader_election.cc:302] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7ce4e578c24f28aafbbee94b1b3ce2, 6af602be79d845efba86055722e92e9b; no voters:
I20260811 10:02:27.624589 10960 raft_consensus.cc:2781] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:27.624761 10960 raft_consensus.cc:686] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7ce4e578c24f28aafbbee94b1b3ce2, State: Running, Role: LEADER
I20260811 10:02:27.624888 10960 consensus_queue.cc:237] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } }
I20260811 10:02:27.625747 10400 catalog_manager.cc:5495] T 7f99de2b960f4ae2993a1396fd6e97e0 P 5f7ce4e578c24f28aafbbee94b1b3ce2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7ce4e578c24f28aafbbee94b1b3ce2 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6af602be79d845efba86055722e92e9b" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7ce4e578c24f28aafbbee94b1b3ce2" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1923bdcbad64c329f16cf671b7e42ca" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34263 } health_report { overall_health: UNKNOWN } } }
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:27.642714 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.635507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59258 (local address 127.9.127.193:34263)
0811 10:02:27.635575 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.635578 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.635681 (+ 103us) server_negotiation.cc:407] Connection header received
0811 10:02:27.635780 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.635782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.635792 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.635861 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:27.636430 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.636995 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.637716 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.637915 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.637991 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.640163 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:27.640172 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:27.640172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:27.640178 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:27.641766 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.642072 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.642081 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.642082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.642134 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.642289 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.642289 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.642289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.642414 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:27.642512 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.642597 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.642654 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:27.667228 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.660571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59270 (local address 127.9.127.193:34263)
0811 10:02:27.660629 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.660631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.660675 (+ 44us) server_negotiation.cc:407] Connection header received
0811 10:02:27.660736 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.660737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.660746 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.660889 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:27.661451 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.661898 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.662626 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.662803 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.662851 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.664941 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:27.664942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:27.664942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:27.664949 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:27.666323 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.666609 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.666610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.666610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.666672 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.666812 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.666812 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.666813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.666888 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:27.666966 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.667067 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.667140 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 10:02:27.671065 10625 tablet.cc:2369] T 7f99de2b960f4ae2993a1396fd6e97e0 P f1923bdcbad64c329f16cf671b7e42ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10348](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:27.689716 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:27.683527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59280 (local address 127.9.127.193:34263)
0811 10:02:27.683589 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:27.683591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:27.683672 (+ 81us) server_negotiation.cc:407] Connection header received
0811 10:02:27.683717 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:27.683718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:27.683727 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:27.683779 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:27.684302 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.684774 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.685475 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:27.685643 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:27.685689 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:27.687628 (+ 1939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:27.687629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:27.687630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:27.687635 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:27.688867 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.689166 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.689166 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.689167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.689216 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:27.689354 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:27.689354 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:27.689354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:27.689428 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:27.689513 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:27.689601 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 10:02:27.689655 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 10:02:27.690376 10524 tablet_service.cc:2908] Rejecting scan request for tablet 7f99de2b960f4ae2993a1396fd6e97e0: Uninitialized: clean time has not yet been initialized
I20260811 10:02:27.691406 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 10476
I20260811 10:02:27.698483 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 10629
I20260811 10:02:27.704365 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 10786
I20260811 10:02:27.710997 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 10362
2026-08-11T10:02:27Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2090 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10980](info): set up 2 sockets
Aug 11 10:02:27 dist-test-slave-1x4g krb5kdc[10980](info): commencing operation
krb5kdc: starting...
W20260811 10:02:28.785462 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:28 dist-test-slave-1x4g krb5kdc[10980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:28.908005 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37301
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:37301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:28.989027 10994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:28.989300 10994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:28.989336 10994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:28.990489 10994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:28.990551 10994 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 10:02:28.990577 10994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:28.990610 10994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:28.990635 10994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:28.990661 10994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:28.992098 10994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:37301
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:28.992367 10994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:28.992587 10994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:28.997426 11000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:28.997355 11001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:28.997359 11005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:28.997519 10994 server_base.cc:1034] running on GCE node
I20260811 10:02:28.997866 10994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:28.998178 10994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:28.999334 10994 hybrid_clock.cc:648] HybridClock initialized: now 1786442548999327 us; error 36 us; skew 500 ppm
Aug 11 10:02:28 dist-test-slave-1x4g krb5kdc[10980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442548, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:29.004988 10994 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:29.005455 10994 webserver.cc:460] Webserver started at http://127.9.127.254:37297/ using document root <none> and password file <none>
I20260811 10:02:29.005679 10994 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:29.005740 10994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:29.005880 10994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:29.006923 10994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "c5669dd0bc3b4b269c1fc86392e4bb42"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "bf5ad2f2fbac984b6c2d5215c642e315"
server_key_iv: "1fd1005c4d09b7f0e82d08b75ccceca8"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.007285 10994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "c5669dd0bc3b4b269c1fc86392e4bb42"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "bf5ad2f2fbac984b6c2d5215c642e315"
server_key_iv: "1fd1005c4d09b7f0e82d08b75ccceca8"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.008562 10994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:29.009346 11013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.009511 10994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.009631 10994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "c5669dd0bc3b4b269c1fc86392e4bb42"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "bf5ad2f2fbac984b6c2d5215c642e315"
server_key_iv: "1fd1005c4d09b7f0e82d08b75ccceca8"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.009711 10994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:29.017902 10994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:29.020133 10994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:29.020292 10994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:29.025552 10994 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:37301
I20260811 10:02:29.025626 11086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:37301 every 8 connection(s)
I20260811 10:02:29.025939 10994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:29.026602 11088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:29.029028 11088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42: Bootstrap starting.
I20260811 10:02:29.029646 11088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:29.029940 11088 log.cc:824] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:29.030645 11088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42: No bootstrap required, opened a new log
I20260811 10:02:29.033066 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 10994
I20260811 10:02:29.033234 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:29.033429 9727 external_mini_cluster.cc:1428] Setting key 9570f8d8d186b2614607783fec68c93f
I20260811 10:02:29.033371 11088 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5669dd0bc3b4b269c1fc86392e4bb42" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37301 } }
I20260811 10:02:29.033583 11088 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:29.033655 11088 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5669dd0bc3b4b269c1fc86392e4bb42, State: Initialized, Role: FOLLOWER
I20260811 10:02:29.033809 11088 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5669dd0bc3b4b269c1fc86392e4bb42" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37301 } }
I20260811 10:02:29.033908 11088 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:29.033944 11088 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:29.033998 11088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:29.034668 11088 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5669dd0bc3b4b269c1fc86392e4bb42" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37301 } }
I20260811 10:02:29.034791 11088 leader_election.cc:302] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5669dd0bc3b4b269c1fc86392e4bb42; no voters:
I20260811 10:02:29.034972 11088 leader_election.cc:288] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:29.035034 11094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:29.035194 11094 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [term 1 LEADER]: Becoming Leader. State: Replica: c5669dd0bc3b4b269c1fc86392e4bb42, State: Running, Role: LEADER
I20260811 10:02:29.035296 11088 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:29.035305 11094 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5669dd0bc3b4b269c1fc86392e4bb42" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37301 } }
I20260811 10:02:29.035704 11096 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5669dd0bc3b4b269c1fc86392e4bb42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5669dd0bc3b4b269c1fc86392e4bb42" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37301 } } }
I20260811 10:02:29.035703 11095 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5669dd0bc3b4b269c1fc86392e4bb42. Latest consensus state: current_term: 1 leader_uuid: "c5669dd0bc3b4b269c1fc86392e4bb42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5669dd0bc3b4b269c1fc86392e4bb42" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37301 } } }
I20260811 10:02:29.035885 11096 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:29.035894 11095 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:29.036293 11106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:29.036876 11106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:29.038422 11106 catalog_manager.cc:1347] Generated new cluster ID: c99e5bc9091f4302b763c73663c6e4bd
I20260811 10:02:29.038479 11106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:29.045444 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.033954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53414 (local address 127.9.127.254:37301)
0811 10:02:29.034138 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.034147 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.034187 (+ 40us) server_negotiation.cc:407] Connection header received
0811 10:02:29.034289 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.034294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.034335 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.034451 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:29.035296 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.036874 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.037862 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.038410 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.038537 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.041071 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:29.041075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:29.041076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:29.041087 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:29.043050 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.043489 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.043492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.043493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.043617 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.043841 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.043842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.043842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.044146 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:29.045060 (+ 914us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.045127 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.045257 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":102,"threads_started":1}
I20260811 10:02:29.047086 11106 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:29.047618 11106 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:29.056802 11106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42: Generated new TSK 0
I20260811 10:02:29.056986 11106 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:29.083789 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37301
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:29.165864 11122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:29.166049 11122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:29.166074 11122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:29.167138 11122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:29.167171 11122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:29.167189 11122 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:29.167205 11122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:29.168591 11122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:37301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:29.168764 11122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:29.169001 11122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:29.173776 11132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:29.173774 11127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:29.173825 11128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:29.174166 11122 server_base.cc:1034] running on GCE node
I20260811 10:02:29.174360 11122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:29.174580 11122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:29.175740 11122 hybrid_clock.cc:648] HybridClock initialized: now 1786442549175731 us; error 34 us; skew 500 ppm
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:29.178177 11122 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:29.178637 11122 webserver.cc:460] Webserver started at http://127.9.127.193:42177/ using document root <none> and password file <none>
I20260811 10:02:29.178858 11122 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:29.178923 11122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:29.179060 11122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:29.180061 11122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "fb5b4adab3964bfa9e7ca1ea49aac218"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "7fdbbc93b547c62d83d559e4f896914d"
server_key_iv: "a3ca7b05b08353da8f7d5b3fc0b03507"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.180414 11122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "fb5b4adab3964bfa9e7ca1ea49aac218"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "7fdbbc93b547c62d83d559e4f896914d"
server_key_iv: "a3ca7b05b08353da8f7d5b3fc0b03507"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.181802 11122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:29.182502 11139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.182667 11122 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:29.182765 11122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "fb5b4adab3964bfa9e7ca1ea49aac218"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "7fdbbc93b547c62d83d559e4f896914d"
server_key_iv: "a3ca7b05b08353da8f7d5b3fc0b03507"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.182842 11122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:29.191741 11122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:29.193449 11122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:29.193599 11122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:29.194054 11122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:29.194110 11122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.194170 11122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:29.194203 11122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:29.201603 11122 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:45447
I20260811 10:02:29.201726 11275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:45447 every 8 connection(s)
I20260811 10:02:29.201980 11122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:29.204507 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.194678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:40343 (local address 127.9.127.254:37301)
0811 10:02:29.194737 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.194739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.194956 (+ 217us) server_negotiation.cc:407] Connection header received
0811 10:02:29.195436 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.195437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.195450 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.195526 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:29.196402 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.197303 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.199004 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.199235 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.199294 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.202048 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:29.202050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:29.202050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:29.202058 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:29.203408 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.203775 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.203776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.203776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.203829 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.204034 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.204035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.204035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.204136 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:29.204187 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.204385 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.204449 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 10:02:29.204674 11148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.194678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37301 (local address 127.9.127.193:40343)
0811 10:02:29.194853 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.194885 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.195338 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.195637 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.195641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.196017 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:29.196302 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.196309 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.197423 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.197424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.198885 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.198889 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.199356 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.199357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.199537 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.200030 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:29.200041 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:29.201955 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:29.203478 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.203484 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.203486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.203708 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.203886 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.203886 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.203887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.203980 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.204188 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:29.204193 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:29.204296 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.204374 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.204486 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
I20260811 10:02:29.205170 11276 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37301
I20260811 10:02:29.205281 11276 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:29.205458 11276 heartbeater.cc:511] Master 127.9.127.254:37301 requested a full tablet report, sending...
I20260811 10:02:29.206045 11033 ts_manager.cc:194] Registered new tserver with Master: fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447)
I20260811 10:02:29.207041 11033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:40343
I20260811 10:02:29.208979 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 11122
I20260811 10:02:29.209089 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:29.209270 9727 external_mini_cluster.cc:1428] Setting key 55f196b99f6dec07a9ff73ced2bcbb67
I20260811 10:02:29.212540 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.206425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:48497 (local address 127.9.127.254:37301)
0811 10:02:29.206472 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.206474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.206590 (+ 116us) server_negotiation.cc:407] Connection header received
0811 10:02:29.206640 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.206641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.206650 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.206701 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:29.207025 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.207610 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.208490 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.208688 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.208751 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.209786 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:29.209787 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:29.209788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:29.209793 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:29.211382 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.211680 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.211681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.211682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.211742 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.211924 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.211925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.211926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.212088 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:29.212157 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.212369 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.212458 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 10:02:29.212553 11282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.206338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37301 (local address 127.9.127.193:48497)
0811 10:02:29.206512 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.206523 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.206585 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.206707 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.206707 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.206888 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:29.206958 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.206960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.207730 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.207731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.208318 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.208321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.208761 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.208762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.208886 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.209306 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:29.209312 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:29.209714 (+ 402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:29.211463 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.211464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.211464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.211624 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.211807 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.211807 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.211808 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.211858 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.212191 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:29.212192 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:29.212254 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.212328 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.212431 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:29.237301 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37301
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:29.319648 11286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:29.319851 11286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:29.319876 11286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:29.321105 11286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:29.321149 11286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:29.321172 11286 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:29.321225 11286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:29.322657 11286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:37301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:29.322886 11286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:29.323145 11286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:29.328052 11291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:29.328111 11292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:29.328043 11294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:29.328241 11286 server_base.cc:1034] running on GCE node
I20260811 10:02:29.328502 11286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:29.328806 11286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:29.329963 11286 hybrid_clock.cc:648] HybridClock initialized: now 1786442549329943 us; error 36 us; skew 500 ppm
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:29.332406 11286 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:29.332888 11286 webserver.cc:460] Webserver started at http://127.9.127.194:41643/ using document root <none> and password file <none>
I20260811 10:02:29.333118 11286 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:29.333163 11286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:29.333294 11286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:29.334267 11286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "38a8cf8f52bd4fa288d185956d5dc67f"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "8bb279a6a757fa7f874727e73a536ae4"
server_key_iv: "5e6b224bd82015b33c3f75180a45b051"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.334613 11286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "38a8cf8f52bd4fa288d185956d5dc67f"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "8bb279a6a757fa7f874727e73a536ae4"
server_key_iv: "5e6b224bd82015b33c3f75180a45b051"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.336169 11286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:29.337072 11301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.337237 11286 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:29.337334 11286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "38a8cf8f52bd4fa288d185956d5dc67f"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "8bb279a6a757fa7f874727e73a536ae4"
server_key_iv: "5e6b224bd82015b33c3f75180a45b051"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.337401 11286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:29.362643 11286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:29.365093 11286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:29.365211 11286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:29.365707 11286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:29.365752 11286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.365777 11286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:29.365816 11286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:29.373651 11286 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:45763
I20260811 10:02:29.374007 11286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:29.374022 11434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:45763 every 8 connection(s)
I20260811 10:02:29.376192 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.366229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:60305 (local address 127.9.127.254:37301)
0811 10:02:29.366317 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.366320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.366548 (+ 228us) server_negotiation.cc:407] Connection header received
0811 10:02:29.366989 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.366991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.367007 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.367100 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:29.367874 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.368678 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.370290 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.370619 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.370683 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.373488 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:29.373490 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:29.373490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:29.373498 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:29.375075 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.375444 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.375444 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.375445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.375500 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.375705 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.375705 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.375705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.375807 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:29.375868 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.376064 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.376129 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 10:02:29.376312 11312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.366179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37301 (local address 127.9.127.194:60305)
0811 10:02:29.366396 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.366434 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.366887 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.367150 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.367153 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.367471 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:29.367750 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.367757 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.368824 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.368825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.370191 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.370194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.370716 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.370717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.370857 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.371414 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:29.371424 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:29.373405 (+ 1981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:29.375152 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.375157 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.375158 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.375375 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.375558 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.375559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.375559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.375651 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.375859 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:29.375861 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:29.375957 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.376027 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.376143 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":108,"threads_started":1}
I20260811 10:02:29.376878 11436 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37301
I20260811 10:02:29.376976 11436 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:29.377177 11436 heartbeater.cc:511] Master 127.9.127.254:37301 requested a full tablet report, sending...
I20260811 10:02:29.377592 11033 ts_manager.cc:194] Registered new tserver with Master: 38a8cf8f52bd4fa288d185956d5dc67f (127.9.127.194:45763)
I20260811 10:02:29.378134 11033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:60305
I20260811 10:02:29.382475 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 11286
I20260811 10:02:29.382582 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:29.382807 9727 external_mini_cluster.cc:1428] Setting key a198538c8d7dd055ad6d0dcd107940ce
I20260811 10:02:29.383682 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.377996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:51535 (local address 127.9.127.254:37301)
0811 10:02:29.378043 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.378045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.378127 (+ 82us) server_negotiation.cc:407] Connection header received
0811 10:02:29.378249 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.378250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.378261 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.378323 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:29.378735 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.379264 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.379929 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.380107 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.380154 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.381004 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:29.381005 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:29.381005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:29.381011 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:29.382390 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.382791 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.382792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.382792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.382842 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.383064 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.383065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.383065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.383258 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:29.383329 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.383536 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.383626 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 10:02:29.383771 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.377883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37301 (local address 127.9.127.194:51535)
0811 10:02:29.378060 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.378072 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.378140 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.378369 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.378371 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.378583 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:29.378651 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.378652 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.379350 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.379351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.379839 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.379841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.380172 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.380173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.380231 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.380565 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:29.380569 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:29.380926 (+ 357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:29.382470 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.382471 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.382472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.382707 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.382915 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.382916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.382917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.382990 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.383334 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:29.383335 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:29.383412 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.383495 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.383627 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:29.407424 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37301
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:29.488834 11446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:29.489059 11446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:29.489106 11446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:29.490267 11446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:29.490330 11446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:29.490366 11446 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:29.490422 11446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:29.491792 11446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:37301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:29.492034 11446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:29.492247 11446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:29.497110 11457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:29.497117 11455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:29.497093 11452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:29.497360 11446 server_base.cc:1034] running on GCE node
I20260811 10:02:29.497586 11446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:29.497836 11446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:29.499001 11446 hybrid_clock.cc:648] HybridClock initialized: now 1786442549498988 us; error 25 us; skew 500 ppm
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:29.501655 11446 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:29.502122 11446 webserver.cc:460] Webserver started at http://127.9.127.195:38525/ using document root <none> and password file <none>
I20260811 10:02:29.502341 11446 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:29.502384 11446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:29.502529 11446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:29.503525 11446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "644ef9b0f58441c1be42fd8c5b617526"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "d729330e3f97e2e5f6f264fd2a0828f1"
server_key_iv: "1d8bd0dd1dfe86f75db72dd1c06cdb96"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.503891 11446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "644ef9b0f58441c1be42fd8c5b617526"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "d729330e3f97e2e5f6f264fd2a0828f1"
server_key_iv: "1d8bd0dd1dfe86f75db72dd1c06cdb96"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.505254 11446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:29.506330 11465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.506533 11446 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:29.506629 11446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "644ef9b0f58441c1be42fd8c5b617526"
format_stamp: "Formatted at 2026-08-11 10:02:29 on dist-test-slave-1x4g"
server_key: "d729330e3f97e2e5f6f264fd2a0828f1"
server_key_iv: "1d8bd0dd1dfe86f75db72dd1c06cdb96"
server_key_version: "encryptionkey@0"
I20260811 10:02:29.506690 11446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:29.539829 11446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:29.542330 11446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:29.542451 11446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:29.542927 11446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:29.542975 11446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.543001 11446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:29.543015 11446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:29.551146 11446 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:44405
I20260811 10:02:29.551208 11598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:44405 every 8 connection(s)
I20260811 10:02:29.551522 11446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:29.552179 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 11446
I20260811 10:02:29.552285 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:29.552413 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.543423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:50167 (local address 127.9.127.254:37301)
0811 10:02:29.543499 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.543502 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.543669 (+ 167us) server_negotiation.cc:407] Connection header received
0811 10:02:29.544129 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.544130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.544144 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.544240 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:29.545033 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.545513 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.546486 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.546694 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.546766 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.549297 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:29.549299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:29.549299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:29.549307 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:29.551015 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.551468 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.551469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.551470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.551542 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.551780 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.551781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.551781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.551912 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:29.551978 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.552248 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.552330 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 10:02:29.552481 9727 external_mini_cluster.cc:1428] Setting key fd03192415bdc8cfdcd84ed7002202db
I20260811 10:02:29.552572 11475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.543378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37301 (local address 127.9.127.195:50167)
0811 10:02:29.543541 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.543580 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.544036 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.544285 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.544288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.544622 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:29.544909 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.544916 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.545606 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.545607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.546391 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.546394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.546775 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.546776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.546906 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.547398 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:29.547409 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:29.549195 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:29.551101 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.551114 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.551116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.551394 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.551608 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.551609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.551609 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.551717 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.551968 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:29.551972 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:29.552116 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.552212 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.552358 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260811 10:02:29.553068 11600 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37301
I20260811 10:02:29.553151 11600 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:29.553339 11600 heartbeater.cc:511] Master 127.9.127.254:37301 requested a full tablet report, sending...
I20260811 10:02:29.553704 11034 ts_manager.cc:194] Registered new tserver with Master: 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405)
I20260811 10:02:29.554225 11034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:50167
I20260811 10:02:29.559433 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.554366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:36277 (local address 127.9.127.254:37301)
0811 10:02:29.554408 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.554410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.554417 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:29.554434 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.554435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.554443 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.554513 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:29.554844 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.555296 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.555923 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.556110 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.556180 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.557200 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:29.557202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:29.557202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:29.557209 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:29.558354 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.558689 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.558690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.558691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.558741 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.558952 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.558953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.558953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.559062 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:29.559128 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.559289 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.559353 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:02:29.559448 11607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.554093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37301 (local address 127.9.127.195:36277)
0811 10:02:29.554220 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.554230 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.554294 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.554520 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.554521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.554697 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:29.554758 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.554759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.555395 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.555396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.555846 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.555847 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.556192 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.556192 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.556262 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.556744 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:29.556748 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:29.557104 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:29.558447 (+ 1343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.558448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.558448 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.558617 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.558823 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:29.558824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:29.558824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:29.558886 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:29.559133 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:29.559134 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:29.559176 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.559252 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.559351 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":74,"threads_started":1}
I20260811 10:02:29.564023 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 10:02:29 dist-test-slave-1x4g krb5kdc[10980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:29.587152 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.580642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33126 (local address 127.9.127.254:37301)
0811 10:02:29.580705 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.580708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.580717 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:29.580749 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.580750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.580759 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.580869 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:29.581395 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.581851 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.582540 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.582709 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.582756 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.584891 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:29.584892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:29.584893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:29.584905 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:29.586205 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.586574 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.586575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.586575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.586621 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:29.586773 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:29.586773 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:29.586774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:29.586853 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:29.586920 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.587017 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.587072 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 10:02:29.588811 11034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:29.590386 11034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:29.596633 11620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.592676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:45763 (local address 127.0.0.1:48536)
0811 10:02:29.592932 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.592975 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.593055 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.593389 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.593392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.593394 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:29.593477 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.593479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.594504 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.594505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.595424 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.595426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.596292 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.596293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.596406 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.596423 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.596497 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.596546 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":73,"threads_started":1}
I20260811 10:02:29.596980 11625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.592930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48536 (local address 127.9.127.194:45763)
0811 10:02:29.593195 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.593199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.593210 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:02:29.593252 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.593254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.593271 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.593563 (+ 292us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:29.593630 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.594412 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.595535 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.596213 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.596283 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.596361 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.596548 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.596599 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":89,"threads_started":1}
I20260811 10:02:29.597383 11626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.592731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:45447 (local address 127.0.0.1:32970)
0811 10:02:29.593307 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.593316 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.593365 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.593702 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.593703 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.593706 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:29.593763 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.593765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.595049 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.595050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.596038 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.596041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.597119 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.597120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.597185 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.597190 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.597274 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.597316 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":145,"threads_started":1}
I20260811 10:02:29.597683 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.592900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32970 (local address 127.9.127.193:45447)
0811 10:02:29.593053 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.593058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.593555 (+ 497us) server_negotiation.cc:407] Connection header received
0811 10:02:29.593598 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.593601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.593617 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.593691 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:29.593849 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.594947 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.596128 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.596944 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.597048 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.597113 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.597534 (+ 421us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.597580 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260811 10:02:29.597885 11619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.593186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:44405 (local address 127.0.0.1:39198)
0811 10:02:29.593431 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.593439 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.593492 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.593786 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.593787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.593790 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:29.593829 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.593831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.595161 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.595162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.596280 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.596283 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.597532 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.597534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.597620 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.597624 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.597680 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.597725 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":90,"thread_start_us":70,"threads_started":1}
I20260811 10:02:29.597738 11360 tablet_service.cc:1467] Processing CreateTablet for tablet 7d9d0969127b4e73bc842e46f14916c3 (DEFAULT_TABLE table=test-table [id=ff313e4f4cd147d9a7d461c1557330dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:29.598162 11627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.593287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39198 (local address 127.9.127.195:44405)
0811 10:02:29.593635 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.593639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.593649 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:02:29.593688 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.593690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.593706 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.593788 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:29.593894 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.595075 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.596388 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.597361 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.597452 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.597506 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.598042 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.598082 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":111,"threads_started":1}
I20260811 10:02:29.598224 11360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d9d0969127b4e73bc842e46f14916c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:29.598760 11522 tablet_service.cc:1467] Processing CreateTablet for tablet 7d9d0969127b4e73bc842e46f14916c3 (DEFAULT_TABLE table=test-table [id=ff313e4f4cd147d9a7d461c1557330dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:29.599082 11522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d9d0969127b4e73bc842e46f14916c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:29.601487 11196 tablet_service.cc:1467] Processing CreateTablet for tablet 7d9d0969127b4e73bc842e46f14916c3 (DEFAULT_TABLE table=test-table [id=ff313e4f4cd147d9a7d461c1557330dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:29.601595 11628 tablet_bootstrap.cc:492] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Bootstrap starting.
I20260811 10:02:29.601840 11196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d9d0969127b4e73bc842e46f14916c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:29.602190 11628 tablet_bootstrap.cc:654] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:29.602573 11628 log.cc:824] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:29.603513 11628 tablet_bootstrap.cc:492] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: No bootstrap required, opened a new log
I20260811 10:02:29.603626 11628 ts_tablet_manager.cc:1397] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:29.605451 11631 tablet_bootstrap.cc:492] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Bootstrap starting.
I20260811 10:02:29.605571 11629 tablet_bootstrap.cc:492] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Bootstrap starting.
I20260811 10:02:29.605798 11628 raft_consensus.cc:348] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.605962 11628 raft_consensus.cc:374] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:29.606003 11628 raft_consensus.cc:729] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a8cf8f52bd4fa288d185956d5dc67f, State: Initialized, Role: FOLLOWER
I20260811 10:02:29.606117 11628 consensus_queue.cc:260] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.606244 11631 tablet_bootstrap.cc:654] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:29.606408 11628 ts_tablet_manager.cc:1428] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:02:29.606504 11629 tablet_bootstrap.cc:654] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:29.606551 11436 heartbeater.cc:503] Master 127.9.127.254:37301 was elected leader, sending a full tablet report...
I20260811 10:02:29.606624 11631 log.cc:824] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:29.606845 11629 log.cc:824] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:29.607590 11629 tablet_bootstrap.cc:492] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: No bootstrap required, opened a new log
I20260811 10:02:29.607658 11629 ts_tablet_manager.cc:1397] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:29.607841 11631 tablet_bootstrap.cc:492] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: No bootstrap required, opened a new log
I20260811 10:02:29.607913 11631 ts_tablet_manager.cc:1397] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 10:02:29.609222 11629 raft_consensus.cc:348] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.609378 11629 raft_consensus.cc:374] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:29.609416 11629 raft_consensus.cc:729] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644ef9b0f58441c1be42fd8c5b617526, State: Initialized, Role: FOLLOWER
I20260811 10:02:29.609541 11629 consensus_queue.cc:260] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.609665 11631 raft_consensus.cc:348] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.609827 11629 ts_tablet_manager.cc:1428] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 10:02:29.609825 11631 raft_consensus.cc:374] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:29.609853 11600 heartbeater.cc:503] Master 127.9.127.254:37301 was elected leader, sending a full tablet report...
I20260811 10:02:29.609871 11631 raft_consensus.cc:729] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb5b4adab3964bfa9e7ca1ea49aac218, State: Initialized, Role: FOLLOWER
I20260811 10:02:29.609987 11631 consensus_queue.cc:260] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.610266 11631 ts_tablet_manager.cc:1428] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:02:29.610302 11276 heartbeater.cc:503] Master 127.9.127.254:37301 was elected leader, sending a full tablet report...
W20260811 10:02:29.624866 11437 tablet.cc:2369] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:02:29.703034 11277 tablet.cc:2369] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:02:29.802160 11601 tablet.cc:2369] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:29.884256 11632 raft_consensus.cc:482] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:29.884383 11632 raft_consensus.cc:504] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.884835 11632 leader_election.cc:288] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405), fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447)
I20260811 10:02:29.887889 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.885170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:40187 (local address 127.9.127.193:45447)
0811 10:02:29.885224 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.885227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.885349 (+ 122us) server_negotiation.cc:407] Connection header received
0811 10:02:29.885427 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.885428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.885438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.885497 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:29.885672 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.886217 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.887207 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.887530 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.887632 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.887641 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.887773 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.887815 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 10:02:29.887893 11627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.885179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:37433 (local address 127.9.127.195:44405)
0811 10:02:29.885234 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.885236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.885315 (+ 79us) server_negotiation.cc:407] Connection header received
0811 10:02:29.885428 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.885430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.885440 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.885472 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:29.885710 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.886199 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.887142 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.887533 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.887620 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.887630 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.887783 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.887826 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 10:02:29.887923 11641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.885033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:44405 (local address 127.9.127.194:37433)
0811 10:02:29.885234 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.885244 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.885317 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.885555 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.885556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.885558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:29.885649 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.885651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.886284 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.886285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.887049 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.887052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.887621 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.887623 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.887691 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.887695 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.887765 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.887825 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":16,"thread_start_us":91,"threads_started":1}
I20260811 10:02:29.887930 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.885085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:45447 (local address 127.9.127.194:40187)
0811 10:02:29.885264 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:29.885274 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:29.885363 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:29.885521 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:29.885522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:29.885525 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:29.885594 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.885596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.886371 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.886372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.887125 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:29.887127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.887636 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.887637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:29.887698 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.887701 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:29.887766 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 10:02:29.887817 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":2,"thread_start_us":82,"threads_started":1}
I20260811 10:02:29.888235 11543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9d0969127b4e73bc842e46f14916c3" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644ef9b0f58441c1be42fd8c5b617526" is_pre_election: true
I20260811 10:02:29.888365 11543 raft_consensus.cc:2454] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 0.
I20260811 10:02:29.888473 11222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9d0969127b4e73bc842e46f14916c3" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" is_pre_election: true
I20260811 10:02:29.888628 11222 raft_consensus.cc:2454] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 0.
I20260811 10:02:29.888711 11305 leader_election.cc:302] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38a8cf8f52bd4fa288d185956d5dc67f, 644ef9b0f58441c1be42fd8c5b617526; no voters:
I20260811 10:02:29.888903 11632 raft_consensus.cc:2781] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:29.888972 11632 raft_consensus.cc:482] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:29.888988 11632 raft_consensus.cc:3037] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:29.889767 11632 raft_consensus.cc:504] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.889919 11632 leader_election.cc:288] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 election: Requested vote from peers 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405), fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447)
I20260811 10:02:29.890100 11222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9d0969127b4e73bc842e46f14916c3" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218"
I20260811 10:02:29.890097 11543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d9d0969127b4e73bc842e46f14916c3" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644ef9b0f58441c1be42fd8c5b617526"
I20260811 10:02:29.890180 11222 raft_consensus.cc:3037] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:29.890180 11543 raft_consensus.cc:3037] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:29.891113 11222 raft_consensus.cc:2454] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 1.
I20260811 10:02:29.891263 11543 raft_consensus.cc:2454] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 1.
I20260811 10:02:29.891305 11303 leader_election.cc:302] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38a8cf8f52bd4fa288d185956d5dc67f, fb5b4adab3964bfa9e7ca1ea49aac218; no voters:
I20260811 10:02:29.891402 11632 raft_consensus.cc:2781] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:29.891520 11632 raft_consensus.cc:686] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 LEADER]: Becoming Leader. State: Replica: 38a8cf8f52bd4fa288d185956d5dc67f, State: Running, Role: LEADER
I20260811 10:02:29.891616 11632 consensus_queue.cc:237] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } }
I20260811 10:02:29.892400 11034 catalog_manager.cc:5495] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f reported cstate change: term changed from 0 to 1, leader changed from <none> to 38a8cf8f52bd4fa288d185956d5dc67f (127.9.127.194). New cstate: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:29.949842 11625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:29.947299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48546 (local address 127.9.127.194:45763)
0811 10:02:29.947368 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:29.947370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:29.947381 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:02:29.947462 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:29.947463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:29.947490 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:29.947561 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:29.947707 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.948172 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.948997 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:29.949189 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:29.949264 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:29.949460 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:29.949564 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:29.949650 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:29.949724 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 10:02:29.949746 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:02:29.951779 11222 raft_consensus.cc:1261] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Refusing update from remote peer 38a8cf8f52bd4fa288d185956d5dc67f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:29.952129 11632 consensus_queue.cc:1035] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:29.953303 11543 raft_consensus.cc:1261] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Refusing update from remote peer 38a8cf8f52bd4fa288d185956d5dc67f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:29.953645 11632 consensus_queue.cc:1035] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Connected to new peer: Peer: permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:29.955411 11647 mvcc.cc:205] Tried to move back new op lower bound from 7317268684599304192 to 7317268684356628480. Current Snapshot: MvccSnapshot[applied={T|T < 7317268684599304192}]
I20260811 10:02:29.955842 11645 mvcc.cc:205] Tried to move back new op lower bound from 7317268684599304192 to 7317268684356628480. Current Snapshot: MvccSnapshot[applied={T|T < 7317268684599304192}]
I20260811 10:02:29.956616 11649 mvcc.cc:205] Tried to move back new op lower bound from 7317268684599304192 to 7317268684356628480. Current Snapshot: MvccSnapshot[applied={T|T < 7317268684599304192}]
I20260811 10:02:29.959860 11034 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:29.959939 11034 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:29.960788 11034 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42: Sending DeleteTablet for 3 replicas of tablet 7d9d0969127b4e73bc842e46f14916c3
I20260811 10:02:29.961315 11522 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d9d0969127b4e73bc842e46f14916c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:29 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:39198
I20260811 10:02:29.961347 11360 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d9d0969127b4e73bc842e46f14916c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:29 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:48536
I20260811 10:02:29.961601 11196 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d9d0969127b4e73bc842e46f14916c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:29 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:32970
I20260811 10:02:29.961678 11034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 10:02:29.961828 11658 tablet_replica.cc:330] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: stopping tablet replica
W20260811 10:02:29.961836 11034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:29.961855 11656 tablet_replica.cc:330] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: stopping tablet replica
I20260811 10:02:29.961920 11658 raft_consensus.cc:2229] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:29.961936 11656 raft_consensus.cc:2229] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:29.962028 11656 raft_consensus.cc:2258] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:29.962343 11657 tablet_replica.cc:330] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: stopping tablet replica
I20260811 10:02:29.962482 11657 raft_consensus.cc:2229] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:29.962520 11656 ts_tablet_manager.cc:1905] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:29.962666 11657 raft_consensus.cc:2258] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:29.963178 11657 ts_tablet_manager.cc:1905] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:29.963598 11196 tablet_service.cc:1467] Processing CreateTablet for tablet a66d412b315b4d96b9e2468e69769e96 (DEFAULT_TABLE table=test-table [id=9ccab1d5126845988ab19ca20c98c910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:29.963717 11196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66d412b315b4d96b9e2468e69769e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:29.964447 11656 ts_tablet_manager.cc:1918] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:29.964538 11656 log.cc:1196] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/7d9d0969127b4e73bc842e46f14916c3
I20260811 10:02:29.964828 11656 ts_tablet_manager.cc:1939] T 7d9d0969127b4e73bc842e46f14916c3 P 644ef9b0f58441c1be42fd8c5b617526: Deleting consensus metadata
I20260811 10:02:29.965181 11631 tablet_bootstrap.cc:492] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: Bootstrap starting.
I20260811 10:02:29.965234 11522 tablet_service.cc:1467] Processing CreateTablet for tablet a66d412b315b4d96b9e2468e69769e96 (DEFAULT_TABLE table=test-table [id=9ccab1d5126845988ab19ca20c98c910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:29.965229 11019 catalog_manager.cc:4841] TS 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405): tablet 7d9d0969127b4e73bc842e46f14916c3 (table test-table [id=ff313e4f4cd147d9a7d461c1557330dc]) successfully deleted
I20260811 10:02:29.965344 11522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66d412b315b4d96b9e2468e69769e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:29.965737 11631 tablet_bootstrap.cc:654] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:29.966295 11629 tablet_bootstrap.cc:492] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: Bootstrap starting.
I20260811 10:02:29.966363 11631 tablet_bootstrap.cc:492] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: No bootstrap required, opened a new log
I20260811 10:02:29.966410 11631 ts_tablet_manager.cc:1397] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:29.966593 11631 raft_consensus.cc:348] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.966679 11631 raft_consensus.cc:374] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:29.966710 11631 raft_consensus.cc:729] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb5b4adab3964bfa9e7ca1ea49aac218, State: Initialized, Role: FOLLOWER
I20260811 10:02:29.966708 11629 tablet_bootstrap.cc:654] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:29.966753 11631 consensus_queue.cc:260] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.966881 11631 ts_tablet_manager.cc:1428] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:29.967141 11657 ts_tablet_manager.cc:1918] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:29.967259 11657 log.cc:1196] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/7d9d0969127b4e73bc842e46f14916c3
I20260811 10:02:29.967602 11657 ts_tablet_manager.cc:1939] T 7d9d0969127b4e73bc842e46f14916c3 P 38a8cf8f52bd4fa288d185956d5dc67f: Deleting consensus metadata
I20260811 10:02:29.967615 11360 tablet_service.cc:1467] Processing CreateTablet for tablet a66d412b315b4d96b9e2468e69769e96 (DEFAULT_TABLE table=test-table [id=9ccab1d5126845988ab19ca20c98c910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:29.967756 11360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a66d412b315b4d96b9e2468e69769e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:29.968093 11019 catalog_manager.cc:4841] TS 38a8cf8f52bd4fa288d185956d5dc67f (127.9.127.194:45763): tablet 7d9d0969127b4e73bc842e46f14916c3 (table test-table [id=ff313e4f4cd147d9a7d461c1557330dc]) successfully deleted
I20260811 10:02:29.968873 11628 tablet_bootstrap.cc:492] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: Bootstrap starting.
I20260811 10:02:29.969034 11658 raft_consensus.cc:2258] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:29.969311 11628 tablet_bootstrap.cc:654] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:29.969619 11629 tablet_bootstrap.cc:492] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: No bootstrap required, opened a new log
I20260811 10:02:29.969679 11629 ts_tablet_manager.cc:1397] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 10:02:29.969837 11629 raft_consensus.cc:348] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.969929 11629 raft_consensus.cc:374] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:29.969946 11628 tablet_bootstrap.cc:492] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: No bootstrap required, opened a new log
I20260811 10:02:29.969960 11629 raft_consensus.cc:729] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644ef9b0f58441c1be42fd8c5b617526, State: Initialized, Role: FOLLOWER
I20260811 10:02:29.969988 11628 ts_tablet_manager.cc:1397] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:29.970012 11629 consensus_queue.cc:260] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.970118 11629 ts_tablet_manager.cc:1428] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:29.970136 11628 raft_consensus.cc:348] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.970218 11628 raft_consensus.cc:374] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:29.970245 11628 raft_consensus.cc:729] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a8cf8f52bd4fa288d185956d5dc67f, State: Initialized, Role: FOLLOWER
I20260811 10:02:29.970288 11628 consensus_queue.cc:260] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.970366 11653 raft_consensus.cc:482] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:29.970425 11653 raft_consensus.cc:504] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.970367 11628 ts_tablet_manager.cc:1428] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:29.970582 11653 leader_election.cc:288] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447), 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405)
I20260811 10:02:29.970765 11222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66d412b315b4d96b9e2468e69769e96" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" is_pre_election: true
I20260811 10:02:29.970844 11222 raft_consensus.cc:2454] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 0.
I20260811 10:02:29.970820 11543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66d412b315b4d96b9e2468e69769e96" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644ef9b0f58441c1be42fd8c5b617526" is_pre_election: true
I20260811 10:02:29.970880 11543 raft_consensus.cc:2454] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 0.
I20260811 10:02:29.971048 11303 leader_election.cc:302] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38a8cf8f52bd4fa288d185956d5dc67f, fb5b4adab3964bfa9e7ca1ea49aac218; no voters:
I20260811 10:02:29.971216 11653 raft_consensus.cc:2781] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:29.971256 11653 raft_consensus.cc:482] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:29.971284 11653 raft_consensus.cc:3037] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:29.972076 11653 raft_consensus.cc:504] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.972209 11653 leader_election.cc:288] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 election: Requested vote from peers fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447), 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405)
I20260811 10:02:29.972345 11222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66d412b315b4d96b9e2468e69769e96" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218"
I20260811 10:02:29.972378 11543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a66d412b315b4d96b9e2468e69769e96" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644ef9b0f58441c1be42fd8c5b617526"
I20260811 10:02:29.972442 11543 raft_consensus.cc:3037] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:29.972540 11222 raft_consensus.cc:3037] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:29.973094 11543 raft_consensus.cc:2454] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 1.
I20260811 10:02:29.973364 11222 raft_consensus.cc:2454] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 1.
I20260811 10:02:29.973363 11305 leader_election.cc:302] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38a8cf8f52bd4fa288d185956d5dc67f, 644ef9b0f58441c1be42fd8c5b617526; no voters:
I20260811 10:02:29.973536 11653 raft_consensus.cc:2781] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:29.973536 11658 ts_tablet_manager.cc:1905] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:29.973591 11653 raft_consensus.cc:686] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 LEADER]: Becoming Leader. State: Replica: 38a8cf8f52bd4fa288d185956d5dc67f, State: Running, Role: LEADER
I20260811 10:02:29.973634 11653 consensus_queue.cc:237] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:29.974128 11033 catalog_manager.cc:5495] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f reported cstate change: term changed from 0 to 1, leader changed from <none> to 38a8cf8f52bd4fa288d185956d5dc67f (127.9.127.194). New cstate: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:29.975543 11658 ts_tablet_manager.cc:1918] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:29.975636 11658 log.cc:1196] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/7d9d0969127b4e73bc842e46f14916c3
I20260811 10:02:29.975878 11658 ts_tablet_manager.cc:1939] T 7d9d0969127b4e73bc842e46f14916c3 P fb5b4adab3964bfa9e7ca1ea49aac218: Deleting consensus metadata
I20260811 10:02:29.976281 11016 catalog_manager.cc:4841] TS fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447): tablet 7d9d0969127b4e73bc842e46f14916c3 (table test-table [id=ff313e4f4cd147d9a7d461c1557330dc]) successfully deleted
Aug 11 10:02:30 dist-test-slave-1x4g krb5kdc[10980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442548, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:30.017853 11669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:30.009650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37301 (local address 127.0.0.1:33128)
0811 10:02:30.009889 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:30.009900 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:30.009967 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:30.010164 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:30.010165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:30.010524 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:30.010575 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:30.010578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.011589 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.011590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:30.012211 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:30.012213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.012692 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.012693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:30.012738 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:30.013424 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:30.013429 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:30.014843 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:30.016747 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:30.016754 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:30.016756 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:30.017025 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:30.017257 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:30.017258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:30.017258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:30.017317 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:30.017604 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:30.017610 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:30.017649 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 10:02:30.017699 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:02:30.017777 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":169,"threads_started":1}
I20260811 10:02:30.017966 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:30.009724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33128 (local address 127.9.127.254:37301)
0811 10:02:30.009803 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:30.009806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:30.009971 (+ 165us) server_negotiation.cc:407] Connection header received
0811 10:02:30.010030 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:30.010031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:30.010046 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:30.010131 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:30.010707 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.011500 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.012316 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.012610 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.012692 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:30.014952 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:30.014953 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:30.014954 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:30.014961 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:30.016631 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:30.017102 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:30.017103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:30.017103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:30.017183 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:30.017379 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:30.017380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:30.017380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:30.017527 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:30.017617 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:30.017750 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 10:02:30.017841 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 10:02:30.020191 11033 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:33128:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 10:02:30.020520 11033 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:30.022089 11196 tablet_service.cc:1467] Processing CreateTablet for tablet 2714d100be80449bb59d4a9ce6005fd5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1750762f10334734966ee4e908e3e2e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:30.022158 11360 tablet_service.cc:1467] Processing CreateTablet for tablet 2714d100be80449bb59d4a9ce6005fd5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1750762f10334734966ee4e908e3e2e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:30.022310 11360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2714d100be80449bb59d4a9ce6005fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:30.022310 11196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2714d100be80449bb59d4a9ce6005fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:30.023873 11631 tablet_bootstrap.cc:492] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: Bootstrap starting.
I20260811 10:02:30.023968 11522 tablet_service.cc:1467] Processing CreateTablet for tablet 2714d100be80449bb59d4a9ce6005fd5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1750762f10334734966ee4e908e3e2e6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:30.024144 11522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2714d100be80449bb59d4a9ce6005fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:30.024227 11631 tablet_bootstrap.cc:654] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:30.024891 11631 tablet_bootstrap.cc:492] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: No bootstrap required, opened a new log
I20260811 10:02:30.024941 11631 ts_tablet_manager.cc:1397] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:30.025053 11631 raft_consensus.cc:348] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.025099 11631 raft_consensus.cc:374] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:30.025112 11631 raft_consensus.cc:729] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb5b4adab3964bfa9e7ca1ea49aac218, State: Initialized, Role: FOLLOWER
I20260811 10:02:30.025141 11631 consensus_queue.cc:260] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.025195 11631 ts_tablet_manager.cc:1428] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:30.025301 11637 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.025347 11637 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:30.025736 11628 tablet_bootstrap.cc:492] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: Bootstrap starting.
I20260811 10:02:30.026059 11629 tablet_bootstrap.cc:492] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: Bootstrap starting.
I20260811 10:02:30.026098 11628 tablet_bootstrap.cc:654] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:30.026527 11629 tablet_bootstrap.cc:654] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:30.026726 11628 tablet_bootstrap.cc:492] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: No bootstrap required, opened a new log
I20260811 10:02:30.026779 11628 ts_tablet_manager.cc:1397] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:30.026934 11628 raft_consensus.cc:348] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.027017 11628 raft_consensus.cc:374] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:30.027055 11628 raft_consensus.cc:729] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a8cf8f52bd4fa288d185956d5dc67f, State: Initialized, Role: FOLLOWER
I20260811 10:02:30.027117 11628 consensus_queue.cc:260] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.027247 11628 ts_tablet_manager.cc:1428] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:30.027380 11629 tablet_bootstrap.cc:492] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: No bootstrap required, opened a new log
I20260811 10:02:30.027356 11653 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.027431 11629 ts_tablet_manager.cc:1397] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:30.027433 11653 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:30.027607 11629 raft_consensus.cc:348] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.027688 11629 raft_consensus.cc:374] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:30.027709 11629 raft_consensus.cc:729] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644ef9b0f58441c1be42fd8c5b617526, State: Initialized, Role: FOLLOWER
I20260811 10:02:30.027747 11629 consensus_queue.cc:260] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.027833 11629 ts_tablet_manager.cc:1428] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:30.027957 11636 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.028031 11636 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:30.248903 11653 raft_consensus.cc:482] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:30.249003 11653 raft_consensus.cc:504] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.249186 11653 leader_election.cc:288] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447), 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405)
I20260811 10:02:30.249442 11543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2714d100be80449bb59d4a9ce6005fd5" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644ef9b0f58441c1be42fd8c5b617526" is_pre_election: true
I20260811 10:02:30.249442 11222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2714d100be80449bb59d4a9ce6005fd5" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" is_pre_election: true
I20260811 10:02:30.249562 11222 raft_consensus.cc:2454] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 0.
I20260811 10:02:30.249558 11543 raft_consensus.cc:2454] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 0.
I20260811 10:02:30.249738 11303 leader_election.cc:302] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38a8cf8f52bd4fa288d185956d5dc67f, fb5b4adab3964bfa9e7ca1ea49aac218; no voters:
I20260811 10:02:30.249854 11653 raft_consensus.cc:2781] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:30.249898 11653 raft_consensus.cc:482] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:30.249918 11653 raft_consensus.cc:3037] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:30.250712 11653 raft_consensus.cc:504] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.250856 11653 leader_election.cc:288] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 election: Requested vote from peers fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447), 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405)
I20260811 10:02:30.251042 11222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2714d100be80449bb59d4a9ce6005fd5" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218"
I20260811 10:02:30.251019 11543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2714d100be80449bb59d4a9ce6005fd5" candidate_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644ef9b0f58441c1be42fd8c5b617526"
I20260811 10:02:30.251112 11222 raft_consensus.cc:3037] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:30.251114 11543 raft_consensus.cc:3037] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:30.251850 11543 raft_consensus.cc:2454] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 1.
I20260811 10:02:30.251871 11222 raft_consensus.cc:2454] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38a8cf8f52bd4fa288d185956d5dc67f in term 1.
I20260811 10:02:30.252063 11305 leader_election.cc:302] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38a8cf8f52bd4fa288d185956d5dc67f, 644ef9b0f58441c1be42fd8c5b617526; no voters:
I20260811 10:02:30.252188 11653 raft_consensus.cc:2781] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:30.252250 11653 raft_consensus.cc:686] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 LEADER]: Becoming Leader. State: Replica: 38a8cf8f52bd4fa288d185956d5dc67f, State: Running, Role: LEADER
I20260811 10:02:30.252307 11653 consensus_queue.cc:237] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } }
I20260811 10:02:30.252558 11642 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: TxnStatusTablet state changed. Reason: New leader 38a8cf8f52bd4fa288d185956d5dc67f. Latest consensus state: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.252645 11642 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:30.252892 11033 catalog_manager.cc:5495] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f reported cstate change: term changed from 0 to 1, leader changed from <none> to 38a8cf8f52bd4fa288d185956d5dc67f (127.9.127.194). New cstate: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:30.253263 11675 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 10:02:30.253386 11675 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 10:02:30.311427 11669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:30.308551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:45763 (local address 127.0.0.1:48562)
0811 10:02:30.308698 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:30.308709 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:30.308789 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:30.308988 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:30.308989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:30.308992 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:30.309044 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:30.309046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.309968 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.309969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:30.310619 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:30.310622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.311073 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.311074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:30.311124 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:30.311139 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:30.311301 (+ 162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:30.311307 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 10:02:30.311335 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 10:02:30.311369 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260811 10:02:30.311439 11625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:30.308622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48562 (local address 127.9.127.194:45763)
0811 10:02:30.308681 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:30.308684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:30.308746 (+ 62us) server_negotiation.cc:407] Connection header received
0811 10:02:30.308868 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:30.308870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:30.308884 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:30.308968 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:30.309138 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.309868 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.310697 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.311000 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.311066 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:30.311214 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:30.311246 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:30.311292 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:30.311350 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 10:02:30.311370 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 10:02:30.312564 11543 raft_consensus.cc:1261] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Refusing update from remote peer 38a8cf8f52bd4fa288d185956d5dc67f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:30.312577 11222 raft_consensus.cc:1261] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Refusing update from remote peer 38a8cf8f52bd4fa288d185956d5dc67f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:30.312811 11653 consensus_queue.cc:1035] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Connected to new peer: Peer: permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:30.312925 11642 consensus_queue.cc:1035] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:30.313551 11636 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: TxnStatusTablet state changed. Reason: New leader 38a8cf8f52bd4fa288d185956d5dc67f. Latest consensus state: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.313652 11636 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:30.313903 11637 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: TxnStatusTablet state changed. Reason: New leader 38a8cf8f52bd4fa288d185956d5dc67f. Latest consensus state: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.314007 11637 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:30.314329 11642 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.314412 11642 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:30.314436 11653 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.314534 11653 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P 38a8cf8f52bd4fa288d185956d5dc67f: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:30.314808 11636 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.314878 11636 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P 644ef9b0f58441c1be42fd8c5b617526: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:30.315285 11637 tablet_replica.cc:439] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 } } peers { permanent_uuid: "38a8cf8f52bd4fa288d185956d5dc67f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45763 } } peers { permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 } } }
I20260811 10:02:30.315382 11637 tablet_replica.cc:442] T 2714d100be80449bb59d4a9ce6005fd5 P fb5b4adab3964bfa9e7ca1ea49aac218: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:30.321255 11625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:30.318719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:44685 (local address 127.9.127.194:45763)
0811 10:02:30.318805 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:30.318806 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:30.318920 (+ 114us) server_negotiation.cc:407] Connection header received
0811 10:02:30.318942 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:30.318943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:30.318952 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:30.319002 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:30.319088 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.319755 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.320461 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.320736 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.320860 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:30.321013 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:30.321042 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:30.321100 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:30.321146 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 10:02:30.321164 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 10:02:30.321255 11682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:30.318663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:45763 (local address 127.9.127.194:44685)
0811 10:02:30.318823 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:30.318833 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:30.318884 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:30.319011 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:30.319011 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:30.319012 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:30.319046 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:30.319046 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.319827 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.319828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:30.320374 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:30.320376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.320862 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.320863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:30.320920 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:30.320934 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:30.321107 (+ 173us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:30.321109 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:02:30.321142 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 10:02:30.321174 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":86,"threads_started":1}
I20260811 10:02:30.323148 11222 raft_consensus.cc:1261] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Refusing update from remote peer 38a8cf8f52bd4fa288d185956d5dc67f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:30.323179 11543 raft_consensus.cc:1261] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Refusing update from remote peer 38a8cf8f52bd4fa288d185956d5dc67f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:30.323346 11642 consensus_queue.cc:1035] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb5b4adab3964bfa9e7ca1ea49aac218" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:30.323458 11642 consensus_queue.cc:1035] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [LEADER]: Connected to new peer: Peer: permanent_uuid: "644ef9b0f58441c1be42fd8c5b617526" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:30.336748 11034 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:30.336882 11034 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:30.337678 11034 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5669dd0bc3b4b269c1fc86392e4bb42: Sending DeleteTablet for 3 replicas of tablet a66d412b315b4d96b9e2468e69769e96
I20260811 10:02:30.338014 11196 tablet_service.cc:1514] Processing DeleteTablet for tablet a66d412b315b4d96b9e2468e69769e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:30 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:32970
I20260811 10:02:30.338013 11360 tablet_service.cc:1514] Processing DeleteTablet for tablet a66d412b315b4d96b9e2468e69769e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:30 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:48536
I20260811 10:02:30.338119 11658 tablet_replica.cc:330] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: stopping tablet replica
I20260811 10:02:30.338136 11657 tablet_replica.cc:330] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: stopping tablet replica
I20260811 10:02:30.338162 11658 raft_consensus.cc:2229] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:30.338194 11658 raft_consensus.cc:2258] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:30.338187 11657 raft_consensus.cc:2229] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:30.338248 11657 raft_consensus.cc:2258] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:30.338505 11522 tablet_service.cc:1514] Processing DeleteTablet for tablet a66d412b315b4d96b9e2468e69769e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:30 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:39198
I20260811 10:02:30.338624 11656 tablet_replica.cc:330] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: stopping tablet replica
I20260811 10:02:30.338675 11656 raft_consensus.cc:2229] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:30.338722 11656 raft_consensus.cc:2258] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:30.339021 11656 ts_tablet_manager.cc:1905] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:30.339129 11657 ts_tablet_manager.cc:1905] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:30.341077 11656 ts_tablet_manager.cc:1918] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:30.341089 11658 ts_tablet_manager.cc:1905] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:30.341143 11656 log.cc:1196] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/a66d412b315b4d96b9e2468e69769e96
I20260811 10:02:30.341377 11656 ts_tablet_manager.cc:1939] T a66d412b315b4d96b9e2468e69769e96 P 644ef9b0f58441c1be42fd8c5b617526: Deleting consensus metadata
I20260811 10:02:30.342702 11658 ts_tablet_manager.cc:1918] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:30.342768 11658 log.cc:1196] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/a66d412b315b4d96b9e2468e69769e96
I20260811 10:02:30.343046 11658 ts_tablet_manager.cc:1939] T a66d412b315b4d96b9e2468e69769e96 P fb5b4adab3964bfa9e7ca1ea49aac218: Deleting consensus metadata
I20260811 10:02:30.343339 11657 ts_tablet_manager.cc:1918] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:30.343412 11657 log.cc:1196] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/a66d412b315b4d96b9e2468e69769e96
I20260811 10:02:30.343554 11016 catalog_manager.cc:4841] TS fb5b4adab3964bfa9e7ca1ea49aac218 (127.9.127.193:45447): tablet a66d412b315b4d96b9e2468e69769e96 (table test-table [id=9ccab1d5126845988ab19ca20c98c910]) successfully deleted
I20260811 10:02:30.343662 11657 ts_tablet_manager.cc:1939] T a66d412b315b4d96b9e2468e69769e96 P 38a8cf8f52bd4fa288d185956d5dc67f: Deleting consensus metadata
I20260811 10:02:30.344015 11019 catalog_manager.cc:4841] TS 644ef9b0f58441c1be42fd8c5b617526 (127.9.127.195:44405): tablet a66d412b315b4d96b9e2468e69769e96 (table test-table [id=9ccab1d5126845988ab19ca20c98c910]) successfully deleted
I20260811 10:02:30.344118 11019 catalog_manager.cc:4841] TS 38a8cf8f52bd4fa288d185956d5dc67f (127.9.127.194:45763): tablet a66d412b315b4d96b9e2468e69769e96 (table test-table [id=9ccab1d5126845988ab19ca20c98c910]) successfully deleted
Aug 11 10:02:30 dist-test-slave-1x4g krb5kdc[10980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442549, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:30.349021 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:30.338844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32984 (local address 127.9.127.193:45447)
0811 10:02:30.338951 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:30.338953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:30.339101 (+ 148us) server_negotiation.cc:407] Connection header received
0811 10:02:30.339200 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:30.339201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:30.339212 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:30.339242 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:30.340072 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.340869 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.341920 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.342195 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.342282 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:30.345898 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:30.345907 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:30.345908 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:30.345916 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:30.347689 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:30.348123 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:30.348126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:30.348126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:30.348206 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:30.348439 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:30.348440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:30.348440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:30.348584 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:30.348729 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:30.348829 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 10:02:30.348927 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260811 10:02:30.349328 11269 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32984
I20260811 10:02:30.356523 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:30.350405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33130 (local address 127.9.127.254:37301)
0811 10:02:30.350451 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:30.350454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:30.350464 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:02:30.350538 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:30.350538 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:30.350547 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:30.350585 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:30.351148 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.351595 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.352498 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:30.352672 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:30.352723 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:30.353999 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:30.354001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:30.354001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:30.354008 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:30.355468 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:30.355801 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:30.355803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:30.355803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:30.355864 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:30.356049 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:30.356050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:30.356050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:30.356181 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:30.356279 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:30.356356 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 10:02:30.356430 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 10:02:30.356751 11034 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33130
I20260811 10:02:30.357456 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 11122
I20260811 10:02:30.368119 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 11286
I20260811 10:02:30.376719 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 11446
I20260811 10:02:30.383641 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 10994
2026-08-11T10:02:30Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2674 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:30 dist-test-slave-1x4g krb5kdc[11693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:30 dist-test-slave-1x4g krb5kdc[11693](info): set up 2 sockets
Aug 11 10:02:30 dist-test-slave-1x4g krb5kdc[11693](info): commencing operation
krb5kdc: starting...
W20260811 10:02:31.463287 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:31 dist-test-slave-1x4g krb5kdc[11693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:31.577411 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:39627
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:39627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:31.657090 11708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:31.657284 11708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:31.657307 11708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:31.658376 11708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:31.658409 11708 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 10:02:31.658422 11708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:31.658435 11708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:31.658447 11708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:31.658458 11708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:31.659794 11708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:39627
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:39627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:31.659997 11708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:31.660162 11708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:31.664845 11714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:31.664888 11713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:31.664909 11708 server_base.cc:1034] running on GCE node
W20260811 10:02:31.664815 11717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:31.665274 11708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:31.665544 11708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:31.666719 11708 hybrid_clock.cc:648] HybridClock initialized: now 1786442551666697 us; error 35 us; skew 500 ppm
Aug 11 10:02:31 dist-test-slave-1x4g krb5kdc[11693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442551, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:31.669099 11708 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:31.669571 11708 webserver.cc:460] Webserver started at http://127.9.127.254:39747/ using document root <none> and password file <none>
I20260811 10:02:31.669800 11708 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:31.669868 11708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:31.670018 11708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:31.671036 11708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "ab2b1e89d0114aada1e38b417ab434f1"
format_stamp: "Formatted at 2026-08-11 10:02:31 on dist-test-slave-1x4g"
server_key: "bf9ebc789d2f334995ec9e21597a8a54"
server_key_iv: "227b292b5e2a4da9f1fce81aabbef245"
server_key_version: "encryptionkey@0"
I20260811 10:02:31.671396 11708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "ab2b1e89d0114aada1e38b417ab434f1"
format_stamp: "Formatted at 2026-08-11 10:02:31 on dist-test-slave-1x4g"
server_key: "bf9ebc789d2f334995ec9e21597a8a54"
server_key_iv: "227b292b5e2a4da9f1fce81aabbef245"
server_key_version: "encryptionkey@0"
I20260811 10:02:31.672696 11708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:02:31.673422 11724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:31.673590 11708 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:31.673694 11708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "ab2b1e89d0114aada1e38b417ab434f1"
format_stamp: "Formatted at 2026-08-11 10:02:31 on dist-test-slave-1x4g"
server_key: "bf9ebc789d2f334995ec9e21597a8a54"
server_key_iv: "227b292b5e2a4da9f1fce81aabbef245"
server_key_version: "encryptionkey@0"
I20260811 10:02:31.673765 11708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:31.696899 11708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:31.698604 11708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:31.698763 11708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:31.703595 11708 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:39627
I20260811 10:02:31.703644 11802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:39627 every 8 connection(s)
I20260811 10:02:31.703940 11708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:31.704520 11803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:31.706820 11803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: Bootstrap starting.
I20260811 10:02:31.707417 11803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:31.707712 11803 log.cc:824] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:31.708411 11803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: No bootstrap required, opened a new log
I20260811 10:02:31.710528 11803 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2b1e89d0114aada1e38b417ab434f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39627 } }
I20260811 10:02:31.710662 11803 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:31.710685 11803 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab2b1e89d0114aada1e38b417ab434f1, State: Initialized, Role: FOLLOWER
I20260811 10:02:31.710847 11803 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2b1e89d0114aada1e38b417ab434f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39627 } }
I20260811 10:02:31.710917 11803 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:31.710944 11803 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:31.710996 11803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:31.711622 11803 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2b1e89d0114aada1e38b417ab434f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39627 } }
I20260811 10:02:31.711726 11803 leader_election.cc:302] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab2b1e89d0114aada1e38b417ab434f1; no voters:
I20260811 10:02:31.711876 11803 leader_election.cc:288] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:31.711911 11806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:31.712064 11806 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [term 1 LEADER]: Becoming Leader. State: Replica: ab2b1e89d0114aada1e38b417ab434f1, State: Running, Role: LEADER
I20260811 10:02:31.712083 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 11708
I20260811 10:02:31.712172 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:31.712147 11806 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2b1e89d0114aada1e38b417ab434f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39627 } }
I20260811 10:02:31.712145 11803 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:31.712345 9727 external_mini_cluster.cc:1428] Setting key 95b49652b7051963bfc6b40b7350a07e
I20260811 10:02:31.712633 11808 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab2b1e89d0114aada1e38b417ab434f1. Latest consensus state: current_term: 1 leader_uuid: "ab2b1e89d0114aada1e38b417ab434f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2b1e89d0114aada1e38b417ab434f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39627 } } }
I20260811 10:02:31.712836 11808 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:31.712641 11807 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab2b1e89d0114aada1e38b417ab434f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2b1e89d0114aada1e38b417ab434f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39627 } } }
I20260811 10:02:31.713025 11807 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:31.713217 11820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:31.713897 11820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:31.715616 11820 catalog_manager.cc:1347] Generated new cluster ID: 55d79b12e0f044e1af559c8292188ac2
I20260811 10:02:31.715672 11820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:02:31 dist-test-slave-1x4g krb5kdc[11693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:31.723068 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:31.712809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44254 (local address 127.9.127.254:39627)
0811 10:02:31.713107 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:31.713117 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:31.713323 (+ 206us) server_negotiation.cc:407] Connection header received
0811 10:02:31.713770 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:31.713778 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:31.713837 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:31.713991 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:31.714842 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.716039 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.716881 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.717324 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.717453 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:31.719705 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:31.719709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:31.719709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:31.719720 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:31.721466 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:31.721863 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:31.721867 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:31.721867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:31.721969 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:31.722193 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:31.722194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:31.722194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:31.722420 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:31.722617 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:31.722728 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 10:02:31.722868 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":89,"threads_started":1}
I20260811 10:02:31.737392 11820 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:31.737914 11820 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:31.748126 11820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: Generated new TSK 0
I20260811 10:02:31.748337 11820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:31.781895 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39627
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:31.862871 11834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:31.863099 11834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:31.863142 11834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:31.864274 11834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:31.864337 11834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:31.864374 11834 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 10:02:31.864423 11834 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:31.864454 11834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:31.865916 11834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:39627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:31.866173 11834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:31.866441 11834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:31.871271 11841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:31.871289 11843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:31.871308 11840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:31.871615 11834 server_base.cc:1034] running on GCE node
I20260811 10:02:31.871794 11834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:31.872004 11834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:31.873183 11834 hybrid_clock.cc:648] HybridClock initialized: now 1786442551873170 us; error 35 us; skew 500 ppm
Aug 11 10:02:31 dist-test-slave-1x4g krb5kdc[11693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442551, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:31.875808 11834 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:31.876237 11834 webserver.cc:460] Webserver started at http://127.9.127.193:39281/ using document root <none> and password file <none>
I20260811 10:02:31.876438 11834 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:31.876544 11834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:31.876659 11834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:31.877863 11834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "847da632eae84f7eb6df086f9d80071a"
format_stamp: "Formatted at 2026-08-11 10:02:31 on dist-test-slave-1x4g"
server_key: "e38a77054c927b58a85b7290b2c05d41"
server_key_iv: "b8600259704c9c8c762039aa9a46f411"
server_key_version: "encryptionkey@0"
I20260811 10:02:31.878163 11834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "847da632eae84f7eb6df086f9d80071a"
format_stamp: "Formatted at 2026-08-11 10:02:31 on dist-test-slave-1x4g"
server_key: "e38a77054c927b58a85b7290b2c05d41"
server_key_iv: "b8600259704c9c8c762039aa9a46f411"
server_key_version: "encryptionkey@0"
I20260811 10:02:31.879369 11834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:02:31.880120 11850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:31.880352 11834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:31.880446 11834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "847da632eae84f7eb6df086f9d80071a"
format_stamp: "Formatted at 2026-08-11 10:02:31 on dist-test-slave-1x4g"
server_key: "e38a77054c927b58a85b7290b2c05d41"
server_key_iv: "b8600259704c9c8c762039aa9a46f411"
server_key_version: "encryptionkey@0"
I20260811 10:02:31.880509 11834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:31.892374 11834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:31.894192 11834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:31.894299 11834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:31.894757 11834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:31.894796 11834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:31.894817 11834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:31.894829 11834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:31.901865 11834 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:38183
I20260811 10:02:31.901934 11988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:38183 every 8 connection(s)
Aug 11 10:02:31 dist-test-slave-1x4g krb5kdc[11693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442551, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:31.902217 11834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:31.906085 11860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:31.895220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39627 (local address 127.9.127.193:47723)
0811 10:02:31.895478 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:31.895514 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:31.896019 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:31.896330 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:31.896334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:31.896758 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:31.897106 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:31.897114 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.898160 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.898161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:31.899569 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:31.899573 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.900026 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.900027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:31.900187 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:31.900760 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:31.900772 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:31.902681 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:31.904301 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:31.904309 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:31.904310 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:31.904587 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:31.904861 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:31.904862 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:31.904862 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:31.905009 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:31.905361 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:31.905367 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:31.905555 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 10:02:31.905666 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 10:02:31.905828 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":102,"threads_started":1}
I20260811 10:02:31.906687 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:31.895251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:47723 (local address 127.9.127.254:39627)
0811 10:02:31.895327 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:31.895329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:31.895588 (+ 259us) server_negotiation.cc:407] Connection header received
0811 10:02:31.896132 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:31.896133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:31.896150 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:31.896204 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:31.897237 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.898056 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.899685 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.899922 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.899980 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:31.902778 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:31.902780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:31.902781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:31.902788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:31.904215 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:31.904655 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:31.904656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:31.904656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:31.904736 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:31.905065 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:31.905066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:31.905067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:31.905273 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:31.905345 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:31.906554 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0811 10:02:31.906627 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 10:02:31.907011 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 11834
I20260811 10:02:31.907116 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:31.907300 9727 external_mini_cluster.cc:1428] Setting key c9a05d2f66b85172827158ba98ea776b
I20260811 10:02:31.907516 11989 heartbeater.cc:347] Connected to a master server at 127.9.127.254:39627
I20260811 10:02:31.907605 11989 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:31.907793 11989 heartbeater.cc:511] Master 127.9.127.254:39627 requested a full tablet report, sending...
I20260811 10:02:31.908751 11747 ts_manager.cc:194] Registered new tserver with Master: 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183)
I20260811 10:02:31.909510 11747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:47723
I20260811 10:02:31.914492 11995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:31.908517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39627 (local address 127.9.127.193:45893)
0811 10:02:31.908665 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:31.908677 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:31.908726 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:31.908875 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:31.908876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:31.909066 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:31.909134 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:31.909136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.910065 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.910066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:31.910598 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:31.910600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.910997 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.910998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:31.911071 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:31.911464 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:31.911468 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:31.911814 (+ 346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:31.913407 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:31.913408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:31.913408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:31.913605 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:31.913815 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:31.913816 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:31.913816 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:31.913875 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:31.914153 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:31.914154 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:31.914210 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 10:02:31.914287 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 10:02:31.914390 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260811 10:02:31.914489 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:31.908681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:45893 (local address 127.9.127.254:39627)
0811 10:02:31.908719 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:31.908721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:31.908730 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:31.908802 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:31.908803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:31.908813 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:31.908869 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:31.909214 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.909946 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.910683 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:31.910893 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:31.910990 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:31.911894 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:31.911895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:31.911896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:31.911902 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:31.913328 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:31.913689 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:31.913690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:31.913691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:31.913746 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:31.913953 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:31.913954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:31.913954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:31.914079 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:31.914148 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:31.914326 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 10:02:31.914397 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:31.933652 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39627
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:32.014081 12000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:32.014288 12000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:32.014312 12000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:32.015398 12000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:32.015436 12000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:32.015455 12000 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 10:02:32.015520 12000 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:32.015548 12000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:32.017004 12000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:39627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:32.017235 12000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:32.017499 12000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:32.022512 12008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:32.022588 12005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:32.022526 12006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:32.022748 12000 server_base.cc:1034] running on GCE node
I20260811 10:02:32.022934 12000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:32.023231 12000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:32.024396 12000 hybrid_clock.cc:648] HybridClock initialized: now 1786442552024372 us; error 36 us; skew 500 ppm
Aug 11 10:02:32 dist-test-slave-1x4g krb5kdc[11693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442552, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:32.026944 12000 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:32.027396 12000 webserver.cc:460] Webserver started at http://127.9.127.194:41779/ using document root <none> and password file <none>
I20260811 10:02:32.027573 12000 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:32.027622 12000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:32.027707 12000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:32.028663 12000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "491adf77012a4702bf3b30cd4d1c8c00"
format_stamp: "Formatted at 2026-08-11 10:02:32 on dist-test-slave-1x4g"
server_key: "ceec023b4fde23d199e8571f726e66af"
server_key_iv: "52f69299145b05b53788f1ff22a387cc"
server_key_version: "encryptionkey@0"
I20260811 10:02:32.029055 12000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "491adf77012a4702bf3b30cd4d1c8c00"
format_stamp: "Formatted at 2026-08-11 10:02:32 on dist-test-slave-1x4g"
server_key: "ceec023b4fde23d199e8571f726e66af"
server_key_iv: "52f69299145b05b53788f1ff22a387cc"
server_key_version: "encryptionkey@0"
I20260811 10:02:32.030319 12000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:32.030963 12020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.031124 12000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:32.031212 12000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "491adf77012a4702bf3b30cd4d1c8c00"
format_stamp: "Formatted at 2026-08-11 10:02:32 on dist-test-slave-1x4g"
server_key: "ceec023b4fde23d199e8571f726e66af"
server_key_iv: "52f69299145b05b53788f1ff22a387cc"
server_key_version: "encryptionkey@0"
I20260811 10:02:32.031268 12000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:32.045786 12000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:32.047588 12000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:32.047685 12000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:32.048234 12000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:32.048290 12000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.048316 12000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:32.048331 12000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.054880 12000 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:45131
I20260811 10:02:32.054966 12149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:45131 every 8 connection(s)
Aug 11 10:02:32 dist-test-slave-1x4g krb5kdc[11693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442552, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:32.055264 12000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:32.058130 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 12000
I20260811 10:02:32.058228 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:32.058439 9727 external_mini_cluster.cc:1428] Setting key e4c6281165f409fbb3c27d3558444c85
I20260811 10:02:32.058657 12033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.048808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39627 (local address 127.9.127.194:56697)
0811 10:02:32.048990 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.049025 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.049561 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.049831 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.049835 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.050216 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:32.050521 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.050528 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.051520 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.051521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.052772 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.052776 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.053194 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.053195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.053327 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.053842 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:32.053852 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:32.055767 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:32.057238 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.057244 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.057246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.057458 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.057652 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.057653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.057653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.057748 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.057986 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:32.057993 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:32.058153 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.058273 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.058436 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
I20260811 10:02:32.058995 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.048805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:56697 (local address 127.9.127.254:39627)
0811 10:02:32.048889 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.048891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.049117 (+ 226us) server_negotiation.cc:407] Connection header received
0811 10:02:32.049683 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.049685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.049699 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.049747 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:32.050616 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.051438 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.052882 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.053094 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.053181 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.055858 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:32.055860 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:32.055860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:32.055866 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:32.057159 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.057529 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.057529 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.057530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.057593 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.057803 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.057804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.057804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.057916 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:32.057968 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.058822 (+ 854us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.058902 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 10:02:32.059404 12150 heartbeater.cc:347] Connected to a master server at 127.9.127.254:39627
I20260811 10:02:32.059512 12150 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:32.059689 12150 heartbeater.cc:511] Master 127.9.127.254:39627 requested a full tablet report, sending...
I20260811 10:02:32.060881 11747 ts_manager.cc:194] Registered new tserver with Master: 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131)
I20260811 10:02:32.061406 11747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:56697
I20260811 10:02:32.066922 12157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.060515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39627 (local address 127.9.127.194:46725)
0811 10:02:32.060671 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.060683 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.060745 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.060893 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.060893 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.061106 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:32.061181 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.061183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.062060 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.062060 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.062599 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.062601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.063057 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.063058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.063115 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.063533 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:32.063538 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:32.063836 (+ 298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:32.065793 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.065795 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.065795 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.066024 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.066241 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.066241 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.066242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.066293 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.066692 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:32.066692 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:32.066737 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.066786 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.066857 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":100,"threads_started":1}
I20260811 10:02:32.066987 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.060605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:46725 (local address 127.9.127.254:39627)
0811 10:02:32.060648 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.060650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.060748 (+ 98us) server_negotiation.cc:407] Connection header received
0811 10:02:32.060818 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.060819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.060829 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.060888 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:32.061280 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.061889 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.062671 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.062978 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.063054 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.063927 (+ 873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:32.063929 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:32.063929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:32.063936 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:32.065709 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.066103 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.066105 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.066105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.066170 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.066355 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.066356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.066357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.066617 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:32.066701 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.066812 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.066892 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:32.086668 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39627
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:32.168869 12160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:32.169052 12160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:32.169076 12160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:32.170169 12160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:32.170202 12160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:32.170221 12160 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 10:02:32.170233 12160 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:32.170249 12160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:32.171574 12160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:39627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:32.171738 12160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:32.171895 12160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:32.176717 12170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:32.176761 12168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:32.176879 12160 server_base.cc:1034] running on GCE node
W20260811 10:02:32.176728 12172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:32.177142 12160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:32.177446 12160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:32.178622 12160 hybrid_clock.cc:648] HybridClock initialized: now 1786442552178610 us; error 29 us; skew 500 ppm
Aug 11 10:02:32 dist-test-slave-1x4g krb5kdc[11693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442552, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:32.181017 12160 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:32.181463 12160 webserver.cc:460] Webserver started at http://127.9.127.195:45135/ using document root <none> and password file <none>
I20260811 10:02:32.181691 12160 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:32.181763 12160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:32.181890 12160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:32.182881 12160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "879a3af2532949afae48325ba81e3301"
format_stamp: "Formatted at 2026-08-11 10:02:32 on dist-test-slave-1x4g"
server_key: "91514c50be7b3793bccc5544418584a7"
server_key_iv: "72d15cd9f54dc0435f0678ec868acf1c"
server_key_version: "encryptionkey@0"
I20260811 10:02:32.183239 12160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "879a3af2532949afae48325ba81e3301"
format_stamp: "Formatted at 2026-08-11 10:02:32 on dist-test-slave-1x4g"
server_key: "91514c50be7b3793bccc5544418584a7"
server_key_iv: "72d15cd9f54dc0435f0678ec868acf1c"
server_key_version: "encryptionkey@0"
I20260811 10:02:32.184656 12160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:32.185489 12180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.185669 12160 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:32.185765 12160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "879a3af2532949afae48325ba81e3301"
format_stamp: "Formatted at 2026-08-11 10:02:32 on dist-test-slave-1x4g"
server_key: "91514c50be7b3793bccc5544418584a7"
server_key_iv: "72d15cd9f54dc0435f0678ec868acf1c"
server_key_version: "encryptionkey@0"
I20260811 10:02:32.185853 12160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:32.198311 12160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:32.200399 12160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:32.200567 12160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:32.201217 12160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:32.201274 12160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.201318 12160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:32.201364 12160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 10:02:32 dist-test-slave-1x4g krb5kdc[11693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442552, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:32.209292 12160 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:45635
I20260811 10:02:32.209373 12314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:45635 every 8 connection(s)
I20260811 10:02:32.209779 12160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:32.211588 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.201683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:48061 (local address 127.9.127.254:39627)
0811 10:02:32.201773 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.201775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.202053 (+ 278us) server_negotiation.cc:407] Connection header received
0811 10:02:32.202772 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.202773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.202784 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.202874 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:32.203805 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.204331 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.206120 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.206332 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.206415 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.208703 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:32.208705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:32.208705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:32.208714 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:32.210423 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.210781 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.210782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.210783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.210836 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.211030 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.211030 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.211030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.211131 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:32.211181 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.211420 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.211525 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 10:02:32.211658 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 12160
I20260811 10:02:32.211755 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:32.211864 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.201668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39627 (local address 127.9.127.195:48061)
0811 10:02:32.201878 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.201930 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.202650 (+ 720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.202954 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.202958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.203366 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:32.203689 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.203696 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.204426 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.204427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.205992 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.205996 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.206439 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.206440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.206589 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.207092 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:32.207104 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:32.208603 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:32.210495 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.210500 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.210502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.210714 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.210877 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.210877 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.210877 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.210977 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.211187 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:32.211192 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:32.211301 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.211389 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.211619 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260811 10:02:32.211979 9727 external_mini_cluster.cc:1428] Setting key bb7b667a94511db996e67f6e6bafae8d
I20260811 10:02:32.212380 12318 heartbeater.cc:347] Connected to a master server at 127.9.127.254:39627
I20260811 10:02:32.212527 12318 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:32.212742 12318 heartbeater.cc:511] Master 127.9.127.254:39627 requested a full tablet report, sending...
I20260811 10:02:32.213138 11747 ts_manager.cc:194] Registered new tserver with Master: 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635)
I20260811 10:02:32.213639 11747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:48061
I20260811 10:02:32.213897 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:02:32.222064 12325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.213479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39627 (local address 127.9.127.195:46189)
0811 10:02:32.213773 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.213784 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.213841 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.216113 (+ 2272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.216113 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.216253 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:32.216311 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.216312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.217256 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.217257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.218121 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.218124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.218468 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.218469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.218567 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.219087 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:32.219092 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:32.219381 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:32.221104 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.221105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.221106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.221282 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.221500 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.221501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.221501 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.221552 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.221825 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:32.221826 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:32.221860 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.221910 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.221997 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":65,"threads_started":1}
I20260811 10:02:32.222173 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.213524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:46189 (local address 127.9.127.254:39627)
0811 10:02:32.213565 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.213567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.213829 (+ 262us) server_negotiation.cc:407] Connection header received
0811 10:02:32.216024 (+ 2195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.216025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.216038 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.216098 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:32.216374 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.217149 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.218205 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.218381 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.218431 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.219478 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:32.219480 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:32.219480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:32.219487 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:32.220994 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.221352 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.221353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.221354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.221421 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.221613 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.221614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.221614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.221764 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:32.221832 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.221941 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.222024 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 11 10:02:32 dist-test-slave-1x4g krb5kdc[11693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 10:02:32 dist-test-slave-1x4g krb5kdc[11693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:32.237761 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.231179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44270 (local address 127.9.127.254:39627)
0811 10:02:32.231233 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.231235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.231256 (+ 21us) server_negotiation.cc:407] Connection header received
0811 10:02:32.231310 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.231311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.231319 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.231363 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:32.231831 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.232242 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.233022 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.233183 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.233233 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.235276 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:32.235277 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:32.235278 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:32.235283 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:32.236471 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.237051 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.237052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.237052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.237119 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.237355 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.237356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.237356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.237453 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:32.237533 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.237628 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.237681 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 10:02:32.239538 11747 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:32.241107 11747 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:32.247468 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.243233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:45131 (local address 127.0.0.1:51254)
0811 10:02:32.243523 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.243534 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.243578 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.243823 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.243826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.243828 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:32.243878 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.243880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.245260 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.245262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.246332 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.246335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.247169 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.247170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.247246 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.247258 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.247329 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.247382 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":39,"thread_start_us":50,"threads_started":1}
I20260811 10:02:32.247664 12338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.243348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54502 (local address 127.9.127.193:38183)
0811 10:02:32.243880 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.243883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.243890 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:32.243921 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.243922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.243953 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.244023 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:32.244270 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.245180 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.246587 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.247164 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.247230 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.247287 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.247513 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.247564 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":83,"threads_started":1}
I20260811 10:02:32.247516 12340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.243469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51254 (local address 127.9.127.194:45131)
0811 10:02:32.243661 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.243665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.243674 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:32.243706 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.243708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.243720 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.243785 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:32.244005 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.245167 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.246426 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.247067 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.247152 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.247206 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.247360 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.247413 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":88,"threads_started":1}
I20260811 10:02:32.247822 12335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.243243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38183 (local address 127.0.0.1:54502)
0811 10:02:32.243635 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.243644 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.243680 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.244094 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.244095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.244098 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:32.244143 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.244145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.245337 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.245338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.246493 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.246496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.247321 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.247321 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.247380 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.247383 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.247428 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.247458 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":24,"thread_start_us":71,"threads_started":1}
I20260811 10:02:32.247972 12336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.243233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:45635 (local address 127.0.0.1:46524)
0811 10:02:32.243410 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.243453 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.243525 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.244443 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.244444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.244446 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:32.244498 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.244500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.245687 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.245688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.246683 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.246685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.247692 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.247694 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.247771 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.247775 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.247841 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.247886 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":2,"thread_start_us":57,"threads_started":1}
I20260811 10:02:32.248144 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.243449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46524 (local address 127.9.127.195:45635)
0811 10:02:32.244282 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.244286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.244295 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:32.244328 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.244330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.244343 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.244424 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:32.244579 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.245599 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.246776 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.247512 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.247595 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.247654 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.247984 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.248041 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":790,"thread_start_us":87,"threads_started":1}
I20260811 10:02:32.248746 12075 tablet_service.cc:1467] Processing CreateTablet for tablet 21881a1471904e098dfe2f8b1d43b0d7 (DEFAULT_TABLE table=test-table [id=9a952a1bed674468b0a5de1266a4c10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:32.248965 12237 tablet_service.cc:1467] Processing CreateTablet for tablet 21881a1471904e098dfe2f8b1d43b0d7 (DEFAULT_TABLE table=test-table [id=9a952a1bed674468b0a5de1266a4c10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:32.249143 12075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21881a1471904e098dfe2f8b1d43b0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.249264 12237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21881a1471904e098dfe2f8b1d43b0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.249226 11890 tablet_service.cc:1467] Processing CreateTablet for tablet 21881a1471904e098dfe2f8b1d43b0d7 (DEFAULT_TABLE table=test-table [id=9a952a1bed674468b0a5de1266a4c10b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:32.249504 11890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21881a1471904e098dfe2f8b1d43b0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.252588 12341 tablet_bootstrap.cc:492] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Bootstrap starting.
I20260811 10:02:32.252950 12343 tablet_bootstrap.cc:492] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Bootstrap starting.
I20260811 10:02:32.253001 12342 tablet_bootstrap.cc:492] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Bootstrap starting.
I20260811 10:02:32.253394 12341 tablet_bootstrap.cc:654] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:32.253541 12343 tablet_bootstrap.cc:654] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:32.253789 12341 log.cc:824] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:32.253813 12343 log.cc:824] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:32.253996 12342 tablet_bootstrap.cc:654] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:32.254335 12342 log.cc:824] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:32.254595 12341 tablet_bootstrap.cc:492] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: No bootstrap required, opened a new log
I20260811 10:02:32.254673 12341 ts_tablet_manager.cc:1397] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 10:02:32.255071 12342 tablet_bootstrap.cc:492] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: No bootstrap required, opened a new log
I20260811 10:02:32.255129 12342 ts_tablet_manager.cc:1397] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:32.256098 12341 raft_consensus.cc:348] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.256278 12341 raft_consensus.cc:374] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.256322 12341 raft_consensus.cc:729] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847da632eae84f7eb6df086f9d80071a, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.256434 12341 consensus_queue.cc:260] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.256752 11989 heartbeater.cc:503] Master 127.9.127.254:39627 was elected leader, sending a full tablet report...
I20260811 10:02:32.256868 12342 raft_consensus.cc:348] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.257035 12342 raft_consensus.cc:374] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.257061 12341 ts_tablet_manager.cc:1428] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 10:02:32.257087 12342 raft_consensus.cc:729] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879a3af2532949afae48325ba81e3301, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.257226 12342 consensus_queue.cc:260] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.257357 12343 tablet_bootstrap.cc:492] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: No bootstrap required, opened a new log
I20260811 10:02:32.257427 12343 ts_tablet_manager.cc:1397] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 10:02:32.257520 12342 ts_tablet_manager.cc:1428] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:02:32.257583 12347 raft_consensus.cc:482] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:32.257654 12318 heartbeater.cc:503] Master 127.9.127.254:39627 was elected leader, sending a full tablet report...
I20260811 10:02:32.257658 12347 raft_consensus.cc:504] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.258414 12347 leader_election.cc:288] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131), 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635)
I20260811 10:02:32.260571 12343 raft_consensus.cc:348] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.260723 12343 raft_consensus.cc:374] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.260752 12343 raft_consensus.cc:729] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491adf77012a4702bf3b30cd4d1c8c00, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.260900 12343 consensus_queue.cc:260] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.261137 12343 ts_tablet_manager.cc:1428] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 10:02:32.261183 12150 heartbeater.cc:503] Master 127.9.127.254:39627 was elected leader, sending a full tablet report...
I20260811 10:02:32.261650 12340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.258398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:59171 (local address 127.9.127.194:45131)
0811 10:02:32.258442 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.258444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.258455 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:02:32.258506 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.258507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.258517 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.258608 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:32.258805 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.259486 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.260550 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.261257 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.261334 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.261343 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.261553 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.261589 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 10:02:32.261654 11860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.258325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:45131 (local address 127.9.127.193:59171)
0811 10:02:32.258390 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.258402 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.258448 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.258661 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.258662 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.258664 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:32.258731 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.258733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.259574 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.259576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.260306 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.260335 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.261380 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.261382 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.261472 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.261477 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.261545 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.261587 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 10:02:32.261953 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21881a1471904e098dfe2f8b1d43b0d7" candidate_uuid: "847da632eae84f7eb6df086f9d80071a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491adf77012a4702bf3b30cd4d1c8c00" is_pre_election: true
I20260811 10:02:32.262104 12096 raft_consensus.cc:2454] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847da632eae84f7eb6df086f9d80071a in term 0.
I20260811 10:02:32.262281 12349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.258606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:45635 (local address 127.9.127.193:44399)
0811 10:02:32.258743 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.258753 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.258805 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.259036 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.259037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.259039 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:32.259142 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.259144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.260060 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.260061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.261223 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.261226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.261953 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.261954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.262045 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.262050 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.262148 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.262189 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
I20260811 10:02:32.262315 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.258861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:44399 (local address 127.9.127.195:45635)
0811 10:02:32.258901 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.258903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.258910 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:32.258931 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.258931 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.258940 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.258998 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:32.259234 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.259940 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.261296 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.261860 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.261932 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.261941 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.262205 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.262251 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:02:32.262334 11852 leader_election.cc:302] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491adf77012a4702bf3b30cd4d1c8c00, 847da632eae84f7eb6df086f9d80071a; no voters:
I20260811 10:02:32.262466 12347 raft_consensus.cc:2781] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:32.262532 12347 raft_consensus.cc:482] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:32.262564 12347 raft_consensus.cc:3037] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.262566 12259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21881a1471904e098dfe2f8b1d43b0d7" candidate_uuid: "847da632eae84f7eb6df086f9d80071a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879a3af2532949afae48325ba81e3301" is_pre_election: true
I20260811 10:02:32.262657 12259 raft_consensus.cc:2454] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847da632eae84f7eb6df086f9d80071a in term 0.
I20260811 10:02:32.263274 12347 raft_consensus.cc:504] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.263442 12347 leader_election.cc:288] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [CANDIDATE]: Term 1 election: Requested vote from peers 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131), 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635)
I20260811 10:02:32.263595 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21881a1471904e098dfe2f8b1d43b0d7" candidate_uuid: "847da632eae84f7eb6df086f9d80071a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491adf77012a4702bf3b30cd4d1c8c00"
I20260811 10:02:32.263615 12259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21881a1471904e098dfe2f8b1d43b0d7" candidate_uuid: "847da632eae84f7eb6df086f9d80071a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879a3af2532949afae48325ba81e3301"
I20260811 10:02:32.263690 12096 raft_consensus.cc:3037] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.263689 12259 raft_consensus.cc:3037] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.264351 12096 raft_consensus.cc:2454] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847da632eae84f7eb6df086f9d80071a in term 1.
I20260811 10:02:32.264371 12259 raft_consensus.cc:2454] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847da632eae84f7eb6df086f9d80071a in term 1.
I20260811 10:02:32.264515 11852 leader_election.cc:302] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491adf77012a4702bf3b30cd4d1c8c00, 847da632eae84f7eb6df086f9d80071a; no voters:
I20260811 10:02:32.264603 12347 raft_consensus.cc:2781] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:32.264765 12347 raft_consensus.cc:686] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 1 LEADER]: Becoming Leader. State: Replica: 847da632eae84f7eb6df086f9d80071a, State: Running, Role: LEADER
I20260811 10:02:32.264907 12347 consensus_queue.cc:237] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.265681 11746 catalog_manager.cc:5495] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a reported cstate change: term changed from 0 to 1, leader changed from <none> to 847da632eae84f7eb6df086f9d80071a (127.9.127.193). New cstate: current_term: 1 leader_uuid: "847da632eae84f7eb6df086f9d80071a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } health_report { overall_health: UNKNOWN } } }
Aug 11 10:02:32 dist-test-slave-1x4g krb5kdc[11693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442551, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:32.299465 12360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.293391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39627 (local address 127.0.0.1:44276)
0811 10:02:32.293550 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.293560 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.293619 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.293736 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.293737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.294037 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:32.294083 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.294085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.294655 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.294655 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.295172 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.295173 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.295458 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.295459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.295499 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.295930 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:32.295934 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:32.297305 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:32.298593 (+ 1288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.298600 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.298602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.298781 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.298940 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:32.298941 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:32.298941 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:32.299010 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:32.299200 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:32.299205 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:32.299247 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.299297 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.299378 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
I20260811 10:02:32.299510 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.293474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44276 (local address 127.9.127.254:39627)
0811 10:02:32.293570 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.293572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.293615 (+ 43us) server_negotiation.cc:407] Connection header received
0811 10:02:32.293660 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.293661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.293669 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.293718 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:32.294142 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.294595 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.295234 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.295400 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.295447 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.297385 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:32.297386 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:32.297387 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:32.297392 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:32.298527 (+ 1135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.298840 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.298841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.298841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.298887 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:32.299058 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:32.299058 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:32.299059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:32.299151 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:32.299197 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.299323 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.299421 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":65}
I20260811 10:02:32.301448 11746 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:44276:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 10:02:32.301651 11746 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:32.303153 12237 tablet_service.cc:1467] Processing CreateTablet for tablet b9c6a1cb401347ceb696d2ce54b95793 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ac4a32f23b114f7cbb0395da209a8892]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:32.303145 12075 tablet_service.cc:1467] Processing CreateTablet for tablet b9c6a1cb401347ceb696d2ce54b95793 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ac4a32f23b114f7cbb0395da209a8892]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:32.303324 12075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c6a1cb401347ceb696d2ce54b95793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.303324 12237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c6a1cb401347ceb696d2ce54b95793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.303283 11890 tablet_service.cc:1467] Processing CreateTablet for tablet b9c6a1cb401347ceb696d2ce54b95793 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ac4a32f23b114f7cbb0395da209a8892]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:32.303485 11890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c6a1cb401347ceb696d2ce54b95793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.304910 12343 tablet_bootstrap.cc:492] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: Bootstrap starting.
I20260811 10:02:32.304934 12342 tablet_bootstrap.cc:492] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: Bootstrap starting.
I20260811 10:02:32.304944 12341 tablet_bootstrap.cc:492] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: Bootstrap starting.
I20260811 10:02:32.305394 12341 tablet_bootstrap.cc:654] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:32.305498 12342 tablet_bootstrap.cc:654] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:32.305509 12343 tablet_bootstrap.cc:654] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: Neither blocks nor log segments found. Creating new log.
W20260811 10:02:32.305868 12151 tablet.cc:2369] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:32.306265 12341 tablet_bootstrap.cc:492] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: No bootstrap required, opened a new log
I20260811 10:02:32.306326 12341 ts_tablet_manager.cc:1397] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:32.306392 12342 tablet_bootstrap.cc:492] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: No bootstrap required, opened a new log
I20260811 10:02:32.306440 12342 ts_tablet_manager.cc:1397] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:32.306440 12341 raft_consensus.cc:348] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.306493 12341 raft_consensus.cc:374] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.306507 12341 raft_consensus.cc:729] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847da632eae84f7eb6df086f9d80071a, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.306562 12341 consensus_queue.cc:260] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.306648 12341 ts_tablet_manager.cc:1428] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.306594 12342 raft_consensus.cc:348] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.306679 12342 raft_consensus.cc:374] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.306701 12342 raft_consensus.cc:729] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879a3af2532949afae48325ba81e3301, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.306703 12347 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.306751 12342 consensus_queue.cc:260] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.306803 12347 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:32.306864 12342 ts_tablet_manager.cc:1428] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:32.306918 12348 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.307005 12348 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:32.307031 12343 tablet_bootstrap.cc:492] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: No bootstrap required, opened a new log
I20260811 10:02:32.307070 12343 ts_tablet_manager.cc:1397] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:32.307212 12343 raft_consensus.cc:348] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.307297 12343 raft_consensus.cc:374] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.307317 12343 raft_consensus.cc:729] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491adf77012a4702bf3b30cd4d1c8c00, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.307361 12343 consensus_queue.cc:260] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.307468 12343 ts_tablet_manager.cc:1428] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.307534 12352 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.307607 12352 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 10:02:32.402941 11990 tablet.cc:2369] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:02:32.460364 12319 tablet.cc:2369] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:32.568871 12348 raft_consensus.cc:482] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:32.568974 12348 raft_consensus.cc:504] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.569356 12348 leader_election.cc:288] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183), 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131)
I20260811 10:02:32.572222 12340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.569690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:60091 (local address 127.9.127.194:45131)
0811 10:02:32.569740 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.569742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.569749 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:32.569783 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.569784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.569792 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.569853 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:32.570068 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.570550 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.571494 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.571838 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.571914 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.571923 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.572112 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.572150 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 10:02:32.572255 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.569553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:45131 (local address 127.9.127.195:60091)
0811 10:02:32.569614 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.569628 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.569694 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.569860 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.569861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.569862 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:32.569975 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.569977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.570637 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.570638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.571381 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.571383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.571924 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.571926 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.572022 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.572025 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.572103 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.572145 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 10:02:32.572256 12338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.569650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:43963 (local address 127.9.127.193:38183)
0811 10:02:32.569702 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.569704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.569817 (+ 113us) server_negotiation.cc:407] Connection header received
0811 10:02:32.569927 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.569928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.569937 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.570008 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:32.570171 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.570632 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.571532 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.571887 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.571971 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.571980 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.572144 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.572184 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 10:02:32.572278 12364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.569569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38183 (local address 127.9.127.195:43963)
0811 10:02:32.569747 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.569756 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.569833 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.570014 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.570015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.570016 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:32.570100 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.570101 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.570719 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.570721 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.571440 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.571442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.571993 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.571994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.572064 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.572067 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.572137 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.572178 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":104,"threads_started":1}
I20260811 10:02:32.572535 11935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c6a1cb401347ceb696d2ce54b95793" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847da632eae84f7eb6df086f9d80071a" is_pre_election: true
I20260811 10:02:32.572595 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c6a1cb401347ceb696d2ce54b95793" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491adf77012a4702bf3b30cd4d1c8c00" is_pre_election: true
I20260811 10:02:32.572656 11935 raft_consensus.cc:2454] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 0.
I20260811 10:02:32.572710 12096 raft_consensus.cc:2454] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 0.
I20260811 10:02:32.572870 12185 leader_election.cc:302] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847da632eae84f7eb6df086f9d80071a, 879a3af2532949afae48325ba81e3301; no voters:
I20260811 10:02:32.573014 12348 raft_consensus.cc:2781] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:32.573053 12348 raft_consensus.cc:482] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:32.573083 12348 raft_consensus.cc:3037] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.573886 12348 raft_consensus.cc:504] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.574028 12348 leader_election.cc:288] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 election: Requested vote from peers 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183), 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131)
I20260811 10:02:32.574165 11935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c6a1cb401347ceb696d2ce54b95793" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847da632eae84f7eb6df086f9d80071a"
I20260811 10:02:32.574258 11935 raft_consensus.cc:3037] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.575009 11935 raft_consensus.cc:2454] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 1.
I20260811 10:02:32.575139 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c6a1cb401347ceb696d2ce54b95793" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491adf77012a4702bf3b30cd4d1c8c00"
I20260811 10:02:32.575191 12185 leader_election.cc:302] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847da632eae84f7eb6df086f9d80071a, 879a3af2532949afae48325ba81e3301; no voters:
I20260811 10:02:32.575217 12096 raft_consensus.cc:3037] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.575279 12348 raft_consensus.cc:2781] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:32.575433 12348 raft_consensus.cc:686] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [term 1 LEADER]: Becoming Leader. State: Replica: 879a3af2532949afae48325ba81e3301, State: Running, Role: LEADER
I20260811 10:02:32.575562 12348 consensus_queue.cc:237] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.575986 12096 raft_consensus.cc:2454] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 1.
I20260811 10:02:32.576213 12365 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: TxnStatusTablet state changed. Reason: New leader 879a3af2532949afae48325ba81e3301. Latest consensus state: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.576333 12365 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:32.576470 11746 catalog_manager.cc:5495] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879a3af2532949afae48325ba81e3301 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } health_report { overall_health: HEALTHY } } }
I20260811 10:02:32.576853 12367 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 10:02:32.576970 12367 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 10:02:32.588367 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.585835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46532 (local address 127.9.127.195:45635)
0811 10:02:32.585900 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.585902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.585911 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:32.586000 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.586001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.586019 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.586084 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:32.586241 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.586725 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.587484 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.587699 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.587774 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.587990 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.588113 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.588203 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.588255 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.588275 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:02:32.588373 12360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.585766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:45635 (local address 127.0.0.1:46532)
0811 10:02:32.585852 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.585879 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.585930 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.586103 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.586105 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.586106 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:32.586158 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.586160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.586819 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.586821 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.587395 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.587397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.587776 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.587777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.587866 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.587884 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.588183 (+ 299us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.588196 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.588246 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.588296 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 10:02:32.590236 12096 raft_consensus.cc:1261] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Refusing update from remote peer 879a3af2532949afae48325ba81e3301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:32.590232 11935 raft_consensus.cc:1261] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Refusing update from remote peer 879a3af2532949afae48325ba81e3301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:32.590521 12348 consensus_queue.cc:1035] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:32.590688 12348 consensus_queue.cc:1035] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:32.591761 12352 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: TxnStatusTablet state changed. Reason: New leader 879a3af2532949afae48325ba81e3301. Latest consensus state: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.591868 12352 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:32.592831 12347 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: TxnStatusTablet state changed. Reason: New leader 879a3af2532949afae48325ba81e3301. Latest consensus state: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.592928 12347 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:32.593482 12348 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.593578 12348 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:32.593734 12370 mvcc.cc:205] Tried to move back new op lower bound from 7317268695407071232 to 7317268695350181888. Current Snapshot: MvccSnapshot[applied={T|T < 7317268695407071232 or (T in {7317268695407071232})}]
I20260811 10:02:32.594374 12352 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.594460 12352 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 491adf77012a4702bf3b30cd4d1c8c00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:32.595016 12348 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.595101 12348 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 879a3af2532949afae48325ba81e3301: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:32.595549 12347 tablet_replica.cc:439] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } } }
I20260811 10:02:32.595631 12347 tablet_replica.cc:442] T b9c6a1cb401347ceb696d2ce54b95793 P 847da632eae84f7eb6df086f9d80071a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:32.595885 12373 mvcc.cc:205] Tried to move back new op lower bound from 7317268695407071232 to 7317268695350181888. Current Snapshot: MvccSnapshot[applied={T|T < 7317268695407071232 or (T in {7317268695407071232})}]
I20260811 10:02:32.598912 12338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.596521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54516 (local address 127.9.127.193:38183)
0811 10:02:32.596565 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.596568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.596577 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:32.596657 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.596658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.596676 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.596762 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:32.596932 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.597397 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.598161 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.598364 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.598438 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.598597 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.598696 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.598783 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.598821 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.598842 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 10:02:32.604079 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.601470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:34695 (local address 127.9.127.195:45635)
0811 10:02:32.601529 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.601531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.601621 (+ 90us) server_negotiation.cc:407] Connection header received
0811 10:02:32.601681 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.601682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.601689 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.601725 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:32.601851 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.602320 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.603409 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.603606 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.603652 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.603855 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.603897 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.603933 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.604019 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.604035 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 10:02:32.604142 12382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.601387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:45635 (local address 127.9.127.193:34695)
0811 10:02:32.601546 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.601557 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.601622 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.601729 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.601730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.601731 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:32.601793 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.601795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.602397 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.602398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.603307 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.603310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.603677 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.603678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.603747 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.603762 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.603963 (+ 201us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.603965 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.604014 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.604055 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260811 10:02:32.606391 12096 raft_consensus.cc:1261] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Refusing update from remote peer 847da632eae84f7eb6df086f9d80071a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:32.606520 12259 raft_consensus.cc:1261] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Refusing update from remote peer 847da632eae84f7eb6df086f9d80071a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:32.606650 12353 consensus_queue.cc:1035] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [LEADER]: Connected to new peer: Peer: permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:32.607292 12353 consensus_queue.cc:1035] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [LEADER]: Connected to new peer: Peer: permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:32.616721 12325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.614062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38183 (local address 127.9.127.195:42965)
0811 10:02:32.614134 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.614145 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.614182 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.614415 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.614415 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.614417 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:32.614475 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.614477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.615125 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.615126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.615886 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.615889 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.616355 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.616356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.616405 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.616419 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.616596 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.616598 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.616633 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.616674 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 10:02:32.616732 12338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.614247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:42965 (local address 127.9.127.193:38183)
0811 10:02:32.614302 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.614304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.614311 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:32.614331 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.614332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.614340 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.614410 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:32.614557 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.615024 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.615978 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.616276 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.616350 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.616496 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.616526 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.616579 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.616636 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.616667 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 10:02:32.626151 11747 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:32.626256 11747 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:32.626998 11747 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: Sending DeleteTablet for 3 replicas of tablet 21881a1471904e098dfe2f8b1d43b0d7
I20260811 10:02:32.627306 11890 tablet_service.cc:1514] Processing DeleteTablet for tablet 21881a1471904e098dfe2f8b1d43b0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:32 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:54502
I20260811 10:02:32.627367 12075 tablet_service.cc:1514] Processing DeleteTablet for tablet 21881a1471904e098dfe2f8b1d43b0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:32 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:51254
I20260811 10:02:32.627722 12237 tablet_service.cc:1514] Processing DeleteTablet for tablet 21881a1471904e098dfe2f8b1d43b0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:32 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:46524
I20260811 10:02:32.627887 11747 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:32.628067 11747 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:32.629294 11890 tablet_service.cc:1467] Processing CreateTablet for tablet e0afbce786ed4174b62a4b7bc7e1d45b (DEFAULT_TABLE table=test-table [id=230520f38479470085f096ac5aeb561e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:32.629316 12075 tablet_service.cc:1467] Processing CreateTablet for tablet e0afbce786ed4174b62a4b7bc7e1d45b (DEFAULT_TABLE table=test-table [id=230520f38479470085f096ac5aeb561e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:32.629432 11890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0afbce786ed4174b62a4b7bc7e1d45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.629436 12075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0afbce786ed4174b62a4b7bc7e1d45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.630841 12343 tablet_bootstrap.cc:492] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: Bootstrap starting.
I20260811 10:02:32.630877 12341 tablet_bootstrap.cc:492] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: Bootstrap starting.
I20260811 10:02:32.631232 12343 tablet_bootstrap.cc:654] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:32.631301 12341 tablet_bootstrap.cc:654] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:32.631991 12237 tablet_service.cc:1467] Processing CreateTablet for tablet e0afbce786ed4174b62a4b7bc7e1d45b (DEFAULT_TABLE table=test-table [id=230520f38479470085f096ac5aeb561e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:32.632110 12237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0afbce786ed4174b62a4b7bc7e1d45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:32.632889 12391 tablet_replica.cc:330] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: stopping tablet replica
I20260811 10:02:32.633050 12391 raft_consensus.cc:2229] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:32.633158 12391 raft_consensus.cc:2258] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:32.633364 12390 tablet_replica.cc:330] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: stopping tablet replica
I20260811 10:02:32.633499 12390 raft_consensus.cc:2229] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:32.633565 12342 tablet_bootstrap.cc:492] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: Bootstrap starting.
I20260811 10:02:32.633687 12390 raft_consensus.cc:2258] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:32.633730 12391 ts_tablet_manager.cc:1905] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:32.634202 12342 tablet_bootstrap.cc:654] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:32.634264 12390 ts_tablet_manager.cc:1905] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:32.635018 12343 tablet_bootstrap.cc:492] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: No bootstrap required, opened a new log
I20260811 10:02:32.635075 12343 ts_tablet_manager.cc:1397] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 10:02:32.635218 12343 raft_consensus.cc:348] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.635290 12343 raft_consensus.cc:374] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.635311 12343 raft_consensus.cc:729] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491adf77012a4702bf3b30cd4d1c8c00, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.635351 12343 consensus_queue.cc:260] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.635463 12343 ts_tablet_manager.cc:1428] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.635802 12342 tablet_bootstrap.cc:492] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: No bootstrap required, opened a new log
I20260811 10:02:32.635856 12342 ts_tablet_manager.cc:1397] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:32.635967 12391 ts_tablet_manager.cc:1918] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:32.635993 12342 raft_consensus.cc:348] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.636059 12342 raft_consensus.cc:374] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.636083 12342 raft_consensus.cc:729] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879a3af2532949afae48325ba81e3301, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.636073 12390 ts_tablet_manager.cc:1918] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:32.636121 12342 consensus_queue.cc:260] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.636153 12390 log.cc:1196] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/21881a1471904e098dfe2f8b1d43b0d7
I20260811 10:02:32.636201 12342 ts_tablet_manager.cc:1428] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:32.636286 12391 log.cc:1196] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/21881a1471904e098dfe2f8b1d43b0d7
I20260811 10:02:32.636435 12390 ts_tablet_manager.cc:1939] T 21881a1471904e098dfe2f8b1d43b0d7 P 847da632eae84f7eb6df086f9d80071a: Deleting consensus metadata
I20260811 10:02:32.636670 12391 ts_tablet_manager.cc:1939] T 21881a1471904e098dfe2f8b1d43b0d7 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting consensus metadata
I20260811 10:02:32.636881 11728 catalog_manager.cc:4841] TS 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183): tablet 21881a1471904e098dfe2f8b1d43b0d7 (table test-table [id=9a952a1bed674468b0a5de1266a4c10b]) successfully deleted
I20260811 10:02:32.637182 11726 catalog_manager.cc:4841] TS 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131): tablet 21881a1471904e098dfe2f8b1d43b0d7 (table test-table [id=9a952a1bed674468b0a5de1266a4c10b]) successfully deleted
I20260811 10:02:32.640897 12392 tablet_replica.cc:330] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: stopping tablet replica
I20260811 10:02:32.641012 12392 raft_consensus.cc:2229] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:32.641070 12392 raft_consensus.cc:2258] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:32.641439 12392 ts_tablet_manager.cc:1905] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:32.643038 12392 ts_tablet_manager.cc:1918] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:32.643110 12392 log.cc:1196] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/21881a1471904e098dfe2f8b1d43b0d7
I20260811 10:02:32.643376 12392 ts_tablet_manager.cc:1939] T 21881a1471904e098dfe2f8b1d43b0d7 P 879a3af2532949afae48325ba81e3301: Deleting consensus metadata
I20260811 10:02:32.643750 11725 catalog_manager.cc:4841] TS 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635): tablet 21881a1471904e098dfe2f8b1d43b0d7 (table test-table [id=9a952a1bed674468b0a5de1266a4c10b]) successfully deleted
I20260811 10:02:32.645164 12341 tablet_bootstrap.cc:492] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: No bootstrap required, opened a new log
I20260811 10:02:32.645220 12341 ts_tablet_manager.cc:1397] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20260811 10:02:32.645351 12341 raft_consensus.cc:348] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.645428 12341 raft_consensus.cc:374] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:32.645464 12341 raft_consensus.cc:729] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847da632eae84f7eb6df086f9d80071a, State: Initialized, Role: FOLLOWER
I20260811 10:02:32.645516 12341 consensus_queue.cc:260] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.645617 12341 ts_tablet_manager.cc:1428] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:32.884027 12377 raft_consensus.cc:482] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:32.884150 12377 raft_consensus.cc:504] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.884366 12377 leader_election.cc:288] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183), 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131)
I20260811 10:02:32.884598 11935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0afbce786ed4174b62a4b7bc7e1d45b" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847da632eae84f7eb6df086f9d80071a" is_pre_election: true
I20260811 10:02:32.884603 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0afbce786ed4174b62a4b7bc7e1d45b" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491adf77012a4702bf3b30cd4d1c8c00" is_pre_election: true
I20260811 10:02:32.884724 11935 raft_consensus.cc:2454] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 0.
I20260811 10:02:32.884737 12096 raft_consensus.cc:2454] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 0.
I20260811 10:02:32.884907 12185 leader_election.cc:302] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847da632eae84f7eb6df086f9d80071a, 879a3af2532949afae48325ba81e3301; no voters:
I20260811 10:02:32.885044 12377 raft_consensus.cc:2781] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:32.885087 12377 raft_consensus.cc:482] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:32.885120 12377 raft_consensus.cc:3037] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.886348 12377 raft_consensus.cc:504] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.886507 12377 leader_election.cc:288] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 election: Requested vote from peers 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183), 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131)
I20260811 10:02:32.886670 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0afbce786ed4174b62a4b7bc7e1d45b" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491adf77012a4702bf3b30cd4d1c8c00"
I20260811 10:02:32.886746 12096 raft_consensus.cc:3037] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.886756 11935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0afbce786ed4174b62a4b7bc7e1d45b" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847da632eae84f7eb6df086f9d80071a"
I20260811 10:02:32.886822 11935 raft_consensus.cc:3037] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:32.887629 11935 raft_consensus.cc:2454] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 1.
I20260811 10:02:32.887629 12096 raft_consensus.cc:2454] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 1.
I20260811 10:02:32.887858 12183 leader_election.cc:302] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491adf77012a4702bf3b30cd4d1c8c00, 879a3af2532949afae48325ba81e3301; no voters:
I20260811 10:02:32.887960 12377 raft_consensus.cc:2781] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:32.888005 12377 raft_consensus.cc:686] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 1 LEADER]: Becoming Leader. State: Replica: 879a3af2532949afae48325ba81e3301, State: Running, Role: LEADER
I20260811 10:02:32.888057 12377 consensus_queue.cc:237] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:32.888716 11747 catalog_manager.cc:5495] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879a3af2532949afae48325ba81e3301 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } health_report { overall_health: HEALTHY } } }
I20260811 10:02:32.919332 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.917367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46548 (local address 127.9.127.195:45635)
0811 10:02:32.917420 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.917422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.917431 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:32.917484 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.917484 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.917496 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.917541 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:32.917627 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.918100 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.918788 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.918968 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.919019 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.919152 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.919177 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.919213 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.919260 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.919278 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:02:32.923265 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.921508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:37591 (local address 127.9.127.195:45635)
0811 10:02:32.921560 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:32.921562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:32.921589 (+ 27us) server_negotiation.cc:407] Connection header received
0811 10:02:32.921606 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:32.921607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:32.921614 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:32.921650 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:32.921738 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.922147 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.922772 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.922931 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.922976 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.923079 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.923099 (+ 20us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.923132 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:32.923191 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 10:02:32.923204 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 10:02:32.923273 12325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:32.921424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:45635 (local address 127.9.127.195:37591)
0811 10:02:32.921481 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:32.921493 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:32.921543 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:32.921665 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:32.921665 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:32.921666 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:32.921699 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.921700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.922209 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.922209 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.922702 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:32.922703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:32.922990 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:32.922990 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:32.923026 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:32.923029 (+ 3us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:32.923144 (+ 115us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:32.923145 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 10:02:32.923177 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 10:02:32.923206 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 10:02:32.925237 12096 raft_consensus.cc:1261] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Refusing update from remote peer 879a3af2532949afae48325ba81e3301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:32.925237 11935 raft_consensus.cc:1261] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Refusing update from remote peer 879a3af2532949afae48325ba81e3301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:32.925487 12365 consensus_queue.cc:1035] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:32.925606 12377 consensus_queue.cc:1035] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:32.926863 12371 mvcc.cc:205] Tried to move back new op lower bound from 7317268696780533760 to 7317268696630099968. Current Snapshot: MvccSnapshot[applied={T|T < 7317268696780533760}]
W20260811 10:02:32.929823 12370 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 10:02:34.447876 11746 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:34.447975 11746 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:34.448812 11746 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: Sending DeleteTablet for 3 replicas of tablet e0afbce786ed4174b62a4b7bc7e1d45b
I20260811 10:02:34.449054 11890 tablet_service.cc:1514] Processing DeleteTablet for tablet e0afbce786ed4174b62a4b7bc7e1d45b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:34 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:54502
I20260811 10:02:34.449100 12075 tablet_service.cc:1514] Processing DeleteTablet for tablet e0afbce786ed4174b62a4b7bc7e1d45b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:34 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:51254
I20260811 10:02:34.449283 12429 tablet_replica.cc:330] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: stopping tablet replica
I20260811 10:02:34.449347 12429 raft_consensus.cc:2229] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:34.449393 12429 raft_consensus.cc:2258] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:34.449519 12428 tablet_replica.cc:330] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: stopping tablet replica
I20260811 10:02:34.449594 12428 raft_consensus.cc:2229] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:34.449666 12428 raft_consensus.cc:2258] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:34.449654 12429 ts_tablet_manager.cc:1905] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:34.449890 12428 ts_tablet_manager.cc:1905] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:34.451195 12236 tablet_service.cc:1514] Processing DeleteTablet for tablet e0afbce786ed4174b62a4b7bc7e1d45b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:34 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:46524
I20260811 10:02:34.451644 12429 ts_tablet_manager.cc:1918] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 10:02:34.451697 12429 log.cc:1196] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/e0afbce786ed4174b62a4b7bc7e1d45b
I20260811 10:02:34.451849 12428 ts_tablet_manager.cc:1918] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 10:02:34.451915 12428 log.cc:1196] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/e0afbce786ed4174b62a4b7bc7e1d45b
I20260811 10:02:34.451946 12429 ts_tablet_manager.cc:1939] T e0afbce786ed4174b62a4b7bc7e1d45b P 491adf77012a4702bf3b30cd4d1c8c00: Deleting consensus metadata
I20260811 10:02:34.452121 12428 ts_tablet_manager.cc:1939] T e0afbce786ed4174b62a4b7bc7e1d45b P 847da632eae84f7eb6df086f9d80071a: Deleting consensus metadata
I20260811 10:02:34.452307 11726 catalog_manager.cc:4841] TS 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131): tablet e0afbce786ed4174b62a4b7bc7e1d45b (table test-table [id=230520f38479470085f096ac5aeb561e]) successfully deleted
I20260811 10:02:34.452812 11728 catalog_manager.cc:4841] TS 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183): tablet e0afbce786ed4174b62a4b7bc7e1d45b (table test-table [id=230520f38479470085f096ac5aeb561e]) successfully deleted
I20260811 10:02:34.453132 12433 tablet_replica.cc:330] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: stopping tablet replica
I20260811 10:02:34.453213 12433 raft_consensus.cc:2229] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:34.453338 12433 raft_consensus.cc:2258] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:34.453722 12433 ts_tablet_manager.cc:1905] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:34.455163 12433 ts_tablet_manager.cc:1918] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 10:02:34.455232 12433 log.cc:1196] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/e0afbce786ed4174b62a4b7bc7e1d45b
I20260811 10:02:34.455479 12433 ts_tablet_manager.cc:1939] T e0afbce786ed4174b62a4b7bc7e1d45b P 879a3af2532949afae48325ba81e3301: Deleting consensus metadata
I20260811 10:02:34.455783 11725 catalog_manager.cc:4841] TS 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635): tablet e0afbce786ed4174b62a4b7bc7e1d45b (table test-table [id=230520f38479470085f096ac5aeb561e]) successfully deleted
Aug 11 10:02:34 dist-test-slave-1x4g krb5kdc[11693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442554, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 10:02:34 dist-test-slave-1x4g krb5kdc[11693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442554, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:34.481050 12440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.468847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44290 (local address 127.9.127.254:39627)
0811 10:02:34.468993 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:34.468996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:34.469066 (+ 70us) server_negotiation.cc:407] Connection header received
0811 10:02:34.469165 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:34.469166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:34.469178 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:34.469248 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:34.469951 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.470484 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.471235 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.471460 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.471561 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.478763 (+ 7202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:34.478764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:34.478765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:34.478771 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:34.480060 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:34.480375 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:34.480376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:34.480376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:34.480432 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:34.480597 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:34.480598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:34.480598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:34.480701 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:34.480827 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:34.480914 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 10:02:34.480983 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260811 10:02:34.482502 11746 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:34.482674 11746 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:34.484127 11890 tablet_service.cc:1467] Processing CreateTablet for tablet 09610b1f6f654e04819783e95dadf157 (DEFAULT_TABLE table=test-table [id=02c727755c1c4ae98270f664b1a40f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:34.484186 12236 tablet_service.cc:1467] Processing CreateTablet for tablet 09610b1f6f654e04819783e95dadf157 (DEFAULT_TABLE table=test-table [id=02c727755c1c4ae98270f664b1a40f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:34.484325 11890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09610b1f6f654e04819783e95dadf157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:34.484349 12236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09610b1f6f654e04819783e95dadf157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:34.485744 12441 tablet_bootstrap.cc:492] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: Bootstrap starting.
I20260811 10:02:34.486104 12441 tablet_bootstrap.cc:654] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:34.486330 12075 tablet_service.cc:1467] Processing CreateTablet for tablet 09610b1f6f654e04819783e95dadf157 (DEFAULT_TABLE table=test-table [id=02c727755c1c4ae98270f664b1a40f19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:34.486465 12075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09610b1f6f654e04819783e95dadf157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:34.486726 12441 tablet_bootstrap.cc:492] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: No bootstrap required, opened a new log
I20260811 10:02:34.486779 12441 ts_tablet_manager.cc:1397] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:34.486878 12441 raft_consensus.cc:348] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.486948 12441 raft_consensus.cc:374] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:34.486967 12441 raft_consensus.cc:729] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847da632eae84f7eb6df086f9d80071a, State: Initialized, Role: FOLLOWER
I20260811 10:02:34.487037 12441 consensus_queue.cc:260] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.487238 12441 ts_tablet_manager.cc:1428] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:34.487912 12445 tablet_bootstrap.cc:492] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: Bootstrap starting.
I20260811 10:02:34.487967 12442 tablet_bootstrap.cc:492] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: Bootstrap starting.
I20260811 10:02:34.488373 12445 tablet_bootstrap.cc:654] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:34.488580 12442 tablet_bootstrap.cc:654] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:34.488996 12445 tablet_bootstrap.cc:492] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: No bootstrap required, opened a new log
I20260811 10:02:34.489063 12445 ts_tablet_manager.cc:1397] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:34.489177 12445 raft_consensus.cc:348] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.489261 12445 raft_consensus.cc:374] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:34.489295 12445 raft_consensus.cc:729] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491adf77012a4702bf3b30cd4d1c8c00, State: Initialized, Role: FOLLOWER
I20260811 10:02:34.489363 12445 consensus_queue.cc:260] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.489533 12445 ts_tablet_manager.cc:1428] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:34.489923 12442 tablet_bootstrap.cc:492] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: No bootstrap required, opened a new log
I20260811 10:02:34.490001 12442 ts_tablet_manager.cc:1397] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 10:02:34.490126 12442 raft_consensus.cc:348] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.490202 12442 raft_consensus.cc:374] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:34.490221 12442 raft_consensus.cc:729] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879a3af2532949afae48325ba81e3301, State: Initialized, Role: FOLLOWER
I20260811 10:02:34.490299 12442 consensus_queue.cc:260] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.490399 12442 ts_tablet_manager.cc:1428] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:34.771402 12449 raft_consensus.cc:482] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:34.771529 12449 raft_consensus.cc:504] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.771937 12449 leader_election.cc:288] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183), 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635)
I20260811 10:02:34.775135 12452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.772213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38183 (local address 127.9.127.194:42017)
0811 10:02:34.772396 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:34.772407 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:34.772466 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:34.772634 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:34.772635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:34.772636 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:34.772720 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:34.772722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.773391 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.773393 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:34.774315 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:34.774318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.774844 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.774845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:34.774927 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.774931 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:34.775010 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 10:02:34.775052 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":106,"threads_started":1}
I20260811 10:02:34.775130 12453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.772295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:42017 (local address 127.9.127.193:38183)
0811 10:02:34.772444 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:34.772446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:34.772454 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:34.772530 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:34.772532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:34.772543 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:34.772630 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:34.772812 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.773307 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.774400 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.774764 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.774846 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.774856 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:34.775020 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 10:02:34.775062 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
I20260811 10:02:34.775362 11935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09610b1f6f654e04819783e95dadf157" candidate_uuid: "491adf77012a4702bf3b30cd4d1c8c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847da632eae84f7eb6df086f9d80071a" is_pre_election: true
I20260811 10:02:34.775473 11935 raft_consensus.cc:2454] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491adf77012a4702bf3b30cd4d1c8c00 in term 0.
I20260811 10:02:34.775664 12025 leader_election.cc:302] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491adf77012a4702bf3b30cd4d1c8c00, 847da632eae84f7eb6df086f9d80071a; no voters:
I20260811 10:02:34.775789 12449 raft_consensus.cc:2781] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:34.775849 12449 raft_consensus.cc:482] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:34.775872 12449 raft_consensus.cc:3037] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:34.776129 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.772165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:45635 (local address 127.9.127.194:55887)
0811 10:02:34.772378 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:34.772390 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:34.772460 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:34.772662 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:34.772663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:34.772665 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:34.772747 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:34.772748 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.773485 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.773486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:34.774848 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:34.774851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.775836 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.775837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:34.775968 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.775973 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:02:34.776031 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 10:02:34.776073 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":133,"threads_started":1}
I20260811 10:02:34.776170 12451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.772225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:55887 (local address 127.9.127.195:45635)
0811 10:02:34.772390 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:34.772392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:34.772440 (+ 48us) server_negotiation.cc:407] Connection header received
0811 10:02:34.772548 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:34.772550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:34.772568 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:34.772659 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:34.772857 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.773392 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.774937 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.775710 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.775794 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.775802 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:34.776060 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 10:02:34.776104 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260811 10:02:34.776507 12259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09610b1f6f654e04819783e95dadf157" candidate_uuid: "491adf77012a4702bf3b30cd4d1c8c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879a3af2532949afae48325ba81e3301" is_pre_election: true
I20260811 10:02:34.776650 12259 raft_consensus.cc:2454] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491adf77012a4702bf3b30cd4d1c8c00 in term 0.
I20260811 10:02:34.776968 12449 raft_consensus.cc:504] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.777118 12449 leader_election.cc:288] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [CANDIDATE]: Term 1 election: Requested vote from peers 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183), 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635)
I20260811 10:02:34.777251 11935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09610b1f6f654e04819783e95dadf157" candidate_uuid: "491adf77012a4702bf3b30cd4d1c8c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847da632eae84f7eb6df086f9d80071a"
I20260811 10:02:34.777333 11935 raft_consensus.cc:3037] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:34.777297 12259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09610b1f6f654e04819783e95dadf157" candidate_uuid: "491adf77012a4702bf3b30cd4d1c8c00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "879a3af2532949afae48325ba81e3301"
I20260811 10:02:34.777362 12259 raft_consensus.cc:3037] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:34.778129 12259 raft_consensus.cc:2454] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491adf77012a4702bf3b30cd4d1c8c00 in term 1.
I20260811 10:02:34.778129 11935 raft_consensus.cc:2454] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491adf77012a4702bf3b30cd4d1c8c00 in term 1.
I20260811 10:02:34.778324 12025 leader_election.cc:302] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491adf77012a4702bf3b30cd4d1c8c00, 847da632eae84f7eb6df086f9d80071a; no voters:
I20260811 10:02:34.778414 12449 raft_consensus.cc:2781] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:34.778574 12449 raft_consensus.cc:686] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 LEADER]: Becoming Leader. State: Replica: 491adf77012a4702bf3b30cd4d1c8c00, State: Running, Role: LEADER
I20260811 10:02:34.778647 12449 consensus_queue.cc:237] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.779369 11745 catalog_manager.cc:5495] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194). New cstate: current_term: 1 leader_uuid: "491adf77012a4702bf3b30cd4d1c8c00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:34.842990 12457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.840245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51256 (local address 127.9.127.194:45131)
0811 10:02:34.840415 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:34.840417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:34.840423 (+ 6us) server_negotiation.cc:407] Connection header received
0811 10:02:34.840463 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:34.840463 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:34.840486 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:34.840557 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:34.840689 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.841267 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.842024 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.842228 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.842278 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.842485 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:34.842594 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:34.842663 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:34.842710 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 10:02:34.842727 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":119,"threads_started":1}
I20260811 10:02:34.847599 12451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.845442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:44021 (local address 127.9.127.195:45635)
0811 10:02:34.845493 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:34.845495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:34.845591 (+ 96us) server_negotiation.cc:407] Connection header received
0811 10:02:34.845644 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:34.845645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:34.845653 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:34.845732 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:34.845830 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.846272 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.847019 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.847195 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.847237 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.847421 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:34.847444 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:34.847479 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:34.847532 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 10:02:34.847549 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 10:02:34.847642 12460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.845299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:45635 (local address 127.9.127.194:44021)
0811 10:02:34.845514 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:34.845523 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:34.845590 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:34.845737 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:34.845737 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:34.845738 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:34.845784 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:34.845785 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.846332 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.846333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:34.846943 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:34.846945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.847250 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.847251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:34.847341 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.847354 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:34.847495 (+ 141us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:34.847497 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:02:34.847530 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 10:02:34.847563 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":75,"threads_started":1}
I20260811 10:02:34.850028 11935 raft_consensus.cc:1261] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Refusing update from remote peer 491adf77012a4702bf3b30cd4d1c8c00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:34.850046 12259 raft_consensus.cc:1261] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Refusing update from remote peer 491adf77012a4702bf3b30cd4d1c8c00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:34.850314 12449 consensus_queue.cc:1035] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:34.850510 12454 consensus_queue.cc:1035] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:34.857909 12457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.855634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:47325 (local address 127.9.127.194:45131)
0811 10:02:34.855672 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:34.855674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:34.855682 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:34.855741 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:34.855742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:34.855751 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:34.855803 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:34.855895 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.856350 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.857213 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.857487 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.857582 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.857751 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:34.857775 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:34.857817 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:34.857851 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 10:02:34.857867 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:02:34.857939 12467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:34.855469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:45131 (local address 127.9.127.195:47325)
0811 10:02:34.855620 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:34.855631 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:34.855681 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:34.855807 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:34.855807 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:34.855809 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:34.855850 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:34.855851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.856436 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.856437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:34.857148 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:34.857150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:34.857594 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:34.857595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:34.857678 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:34.857683 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:34.857820 (+ 137us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:34.857821 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 10:02:34.857850 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 10:02:34.857885 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260811 10:02:34.864881 11745 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:34.864992 11745 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:34.865613 11745 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: Sending DeleteTablet for 3 replicas of tablet 09610b1f6f654e04819783e95dadf157
I20260811 10:02:34.865844 11890 tablet_service.cc:1514] Processing DeleteTablet for tablet 09610b1f6f654e04819783e95dadf157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:34 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:54502
I20260811 10:02:34.865916 12236 tablet_service.cc:1514] Processing DeleteTablet for tablet 09610b1f6f654e04819783e95dadf157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:34 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:46524
I20260811 10:02:34.865939 12428 tablet_replica.cc:330] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: stopping tablet replica
I20260811 10:02:34.865989 12428 raft_consensus.cc:2229] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:34.866044 12428 raft_consensus.cc:2258] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:34.866112 12433 tablet_replica.cc:330] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: stopping tablet replica
I20260811 10:02:34.866168 12433 raft_consensus.cc:2229] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:34.866241 12433 raft_consensus.cc:2258] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:34.866357 12075 tablet_service.cc:1514] Processing DeleteTablet for tablet 09610b1f6f654e04819783e95dadf157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:34 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:51254
I20260811 10:02:34.866453 12429 tablet_replica.cc:330] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: stopping tablet replica
I20260811 10:02:34.866459 12428 ts_tablet_manager.cc:1905] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:34.866506 12429 raft_consensus.cc:2229] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:34.866580 12429 raft_consensus.cc:2258] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:34.866880 12433 ts_tablet_manager.cc:1905] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:34.866878 12429 ts_tablet_manager.cc:1905] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:34.868360 11745 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 10:02:34.868484 12433 ts_tablet_manager.cc:1918] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
W20260811 10:02:34.868505 11745 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:34.868541 12433 log.cc:1196] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/09610b1f6f654e04819783e95dadf157
I20260811 10:02:34.868521 12428 ts_tablet_manager.cc:1918] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:34.868573 12428 log.cc:1196] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/09610b1f6f654e04819783e95dadf157
I20260811 10:02:34.868804 12433 ts_tablet_manager.cc:1939] T 09610b1f6f654e04819783e95dadf157 P 879a3af2532949afae48325ba81e3301: Deleting consensus metadata
I20260811 10:02:34.868819 12428 ts_tablet_manager.cc:1939] T 09610b1f6f654e04819783e95dadf157 P 847da632eae84f7eb6df086f9d80071a: Deleting consensus metadata
I20260811 10:02:34.869156 11728 catalog_manager.cc:4841] TS 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183): tablet 09610b1f6f654e04819783e95dadf157 (table test-table [id=02c727755c1c4ae98270f664b1a40f19]) successfully deleted
I20260811 10:02:34.869347 12429 ts_tablet_manager.cc:1918] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:34.869442 12429 log.cc:1196] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/09610b1f6f654e04819783e95dadf157
I20260811 10:02:34.869678 12429 ts_tablet_manager.cc:1939] T 09610b1f6f654e04819783e95dadf157 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting consensus metadata
I20260811 10:02:34.869864 11890 tablet_service.cc:1467] Processing CreateTablet for tablet ad4f91dfa38b4867a366994a81f88ed0 (DEFAULT_TABLE table=test-table [id=86afc55cc91647d2926bcb23ecc536f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:34.869925 12075 tablet_service.cc:1467] Processing CreateTablet for tablet ad4f91dfa38b4867a366994a81f88ed0 (DEFAULT_TABLE table=test-table [id=86afc55cc91647d2926bcb23ecc536f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:34.869968 11890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad4f91dfa38b4867a366994a81f88ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:34.870007 12075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad4f91dfa38b4867a366994a81f88ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:34.870028 12236 tablet_service.cc:1467] Processing CreateTablet for tablet ad4f91dfa38b4867a366994a81f88ed0 (DEFAULT_TABLE table=test-table [id=86afc55cc91647d2926bcb23ecc536f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:34.870137 12236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad4f91dfa38b4867a366994a81f88ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:34.871284 12441 tablet_bootstrap.cc:492] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a: Bootstrap starting.
I20260811 10:02:34.871379 12445 tablet_bootstrap.cc:492] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: Bootstrap starting.
I20260811 10:02:34.871625 12441 tablet_bootstrap.cc:654] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:34.871685 12445 tablet_bootstrap.cc:654] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:34.871821 12442 tablet_bootstrap.cc:492] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: Bootstrap starting.
I20260811 10:02:34.872087 11726 catalog_manager.cc:4841] TS 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131): tablet 09610b1f6f654e04819783e95dadf157 (table test-table [id=02c727755c1c4ae98270f664b1a40f19]) successfully deleted
I20260811 10:02:34.872126 12442 tablet_bootstrap.cc:654] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:34.872641 11725 catalog_manager.cc:4841] TS 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635): tablet 09610b1f6f654e04819783e95dadf157 (table test-table [id=02c727755c1c4ae98270f664b1a40f19]) successfully deleted
I20260811 10:02:34.872682 12441 tablet_bootstrap.cc:492] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a: No bootstrap required, opened a new log
I20260811 10:02:34.872687 12445 tablet_bootstrap.cc:492] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: No bootstrap required, opened a new log
I20260811 10:02:34.872727 12441 ts_tablet_manager.cc:1397] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:34.872731 12445 ts_tablet_manager.cc:1397] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:34.872928 12441 raft_consensus.cc:348] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.872964 12445 raft_consensus.cc:348] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.873040 12441 raft_consensus.cc:374] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:34.873051 12445 raft_consensus.cc:374] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:34.873066 12441 raft_consensus.cc:729] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847da632eae84f7eb6df086f9d80071a, State: Initialized, Role: FOLLOWER
I20260811 10:02:34.873082 12445 raft_consensus.cc:729] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491adf77012a4702bf3b30cd4d1c8c00, State: Initialized, Role: FOLLOWER
I20260811 10:02:34.873111 12441 consensus_queue.cc:260] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.873121 12445 consensus_queue.cc:260] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.873204 12441 ts_tablet_manager.cc:1428] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:34.873253 12445 ts_tablet_manager.cc:1428] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:34.873497 12442 tablet_bootstrap.cc:492] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: No bootstrap required, opened a new log
I20260811 10:02:34.873567 12442 ts_tablet_manager.cc:1397] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 10:02:34.873688 12442 raft_consensus.cc:348] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.873777 12442 raft_consensus.cc:374] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:34.873805 12442 raft_consensus.cc:729] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879a3af2532949afae48325ba81e3301, State: Initialized, Role: FOLLOWER
I20260811 10:02:34.873848 12442 consensus_queue.cc:260] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:34.873945 12442 ts_tablet_manager.cc:1428] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:35.253300 12412 raft_consensus.cc:482] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:35.253409 12412 raft_consensus.cc:504] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:35.253618 12412 leader_election.cc:288] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183), 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131)
I20260811 10:02:35.253904 11935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4f91dfa38b4867a366994a81f88ed0" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847da632eae84f7eb6df086f9d80071a" is_pre_election: true
I20260811 10:02:35.253904 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4f91dfa38b4867a366994a81f88ed0" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491adf77012a4702bf3b30cd4d1c8c00" is_pre_election: true
I20260811 10:02:35.254026 12096 raft_consensus.cc:2454] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 0.
I20260811 10:02:35.254025 11935 raft_consensus.cc:2454] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 0.
I20260811 10:02:35.254194 12185 leader_election.cc:302] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847da632eae84f7eb6df086f9d80071a, 879a3af2532949afae48325ba81e3301; no voters:
I20260811 10:02:35.254330 12412 raft_consensus.cc:2781] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:35.254390 12412 raft_consensus.cc:482] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:35.254415 12412 raft_consensus.cc:3037] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:35.255139 12412 raft_consensus.cc:504] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:35.255286 12412 leader_election.cc:288] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 election: Requested vote from peers 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183), 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131)
I20260811 10:02:35.255426 12096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4f91dfa38b4867a366994a81f88ed0" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491adf77012a4702bf3b30cd4d1c8c00"
I20260811 10:02:35.255430 11935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4f91dfa38b4867a366994a81f88ed0" candidate_uuid: "879a3af2532949afae48325ba81e3301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847da632eae84f7eb6df086f9d80071a"
I20260811 10:02:35.255508 12096 raft_consensus.cc:3037] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:35.255524 11935 raft_consensus.cc:3037] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:35.256138 12096 raft_consensus.cc:2454] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 1.
I20260811 10:02:35.256268 11935 raft_consensus.cc:2454] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879a3af2532949afae48325ba81e3301 in term 1.
I20260811 10:02:35.256304 12183 leader_election.cc:302] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491adf77012a4702bf3b30cd4d1c8c00, 879a3af2532949afae48325ba81e3301; no voters:
I20260811 10:02:35.256428 12412 raft_consensus.cc:2781] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:35.256486 12412 raft_consensus.cc:686] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 1 LEADER]: Becoming Leader. State: Replica: 879a3af2532949afae48325ba81e3301, State: Running, Role: LEADER
I20260811 10:02:35.256552 12412 consensus_queue.cc:237] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } }
I20260811 10:02:35.257191 11746 catalog_manager.cc:5495] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 879a3af2532949afae48325ba81e3301 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "879a3af2532949afae48325ba81e3301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879a3af2532949afae48325ba81e3301" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45635 } health_report { overall_health: HEALTHY } } }
I20260811 10:02:35.318212 12451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:35.315895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46562 (local address 127.9.127.195:45635)
0811 10:02:35.315941 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:35.315943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:35.315961 (+ 18us) server_negotiation.cc:407] Connection header received
0811 10:02:35.315985 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:35.315986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:35.315998 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:35.316051 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:35.316177 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:35.316659 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:35.317471 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:35.317692 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:35.317771 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:35.317933 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:35.317966 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:35.318024 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:35.318103 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 10:02:35.318127 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:02:35.320353 12096 raft_consensus.cc:1261] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Refusing update from remote peer 879a3af2532949afae48325ba81e3301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:35.320395 11935 raft_consensus.cc:1261] T ad4f91dfa38b4867a366994a81f88ed0 P 847da632eae84f7eb6df086f9d80071a [term 1 FOLLOWER]: Refusing update from remote peer 879a3af2532949afae48325ba81e3301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:35.320602 12412 consensus_queue.cc:1035] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491adf77012a4702bf3b30cd4d1c8c00" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 45131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:35.320713 12406 consensus_queue.cc:1035] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847da632eae84f7eb6df086f9d80071a" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 10:02:35.325294 12404 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 10:02:36.844435 11745 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:36.844537 11745 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:36.845453 11745 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab2b1e89d0114aada1e38b417ab434f1: Sending DeleteTablet for 3 replicas of tablet ad4f91dfa38b4867a366994a81f88ed0
I20260811 10:02:36.845741 11890 tablet_service.cc:1514] Processing DeleteTablet for tablet ad4f91dfa38b4867a366994a81f88ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:36 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:54502
I20260811 10:02:36.845786 12236 tablet_service.cc:1514] Processing DeleteTablet for tablet ad4f91dfa38b4867a366994a81f88ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:36 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:46524
I20260811 10:02:36.845795 12075 tablet_service.cc:1514] Processing DeleteTablet for tablet ad4f91dfa38b4867a366994a81f88ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:36 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:51254
I20260811 10:02:36.845916 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 11834
I20260811 10:02:36.849660 12498 tablet_replica.cc:330] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: stopping tablet replica
I20260811 10:02:36.849720 12498 raft_consensus.cc:2229] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:36.849771 12498 raft_consensus.cc:2258] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:36.849982 12498 ts_tablet_manager.cc:1905] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:36.850764 12499 tablet_replica.cc:330] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: stopping tablet replica
I20260811 10:02:36.850834 12499 raft_consensus.cc:2229] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:36.850876 12499 raft_consensus.cc:2258] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:36.851296 12499 ts_tablet_manager.cc:1905] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:36.851929 12498 ts_tablet_manager.cc:1918] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 10:02:36.852002 12498 log.cc:1196] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/ad4f91dfa38b4867a366994a81f88ed0
I20260811 10:02:36.852281 12498 ts_tablet_manager.cc:1939] T ad4f91dfa38b4867a366994a81f88ed0 P 879a3af2532949afae48325ba81e3301: Deleting consensus metadata
I20260811 10:02:36.852757 11725 catalog_manager.cc:4841] TS 879a3af2532949afae48325ba81e3301 (127.9.127.195:45635): tablet ad4f91dfa38b4867a366994a81f88ed0 (table test-table [id=86afc55cc91647d2926bcb23ecc536f1]) successfully deleted
I20260811 10:02:36.853088 12499 ts_tablet_manager.cc:1918] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 10:02:36.853181 12499 log.cc:1196] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/ad4f91dfa38b4867a366994a81f88ed0
I20260811 10:02:36.853381 12499 ts_tablet_manager.cc:1939] T ad4f91dfa38b4867a366994a81f88ed0 P 491adf77012a4702bf3b30cd4d1c8c00: Deleting consensus metadata
I20260811 10:02:36.857738 11726 catalog_manager.cc:4841] TS 491adf77012a4702bf3b30cd4d1c8c00 (127.9.127.194:45131): tablet ad4f91dfa38b4867a366994a81f88ed0 (table test-table [id=86afc55cc91647d2926bcb23ecc536f1]) successfully deleted
W20260811 10:02:36.862910 11728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:38183 (error 108)
I20260811 10:02:36.863269 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 12000
I20260811 10:02:36.865904 12502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:36.863348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38183 (local address 127.0.0.1:54522)
0811 10:02:36.865812 (+ 2464us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:36.865870 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:38183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2438,"thread_start_us":74,"threads_started":1}
W20260811 10:02:36.866039 11728 catalog_manager.cc:4584] TS 847da632eae84f7eb6df086f9d80071a (127.9.127.193:38183): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ad4f91dfa38b4867a366994a81f88ed0: Network error: Client connection negotiation failed: client connection to 127.9.127.193:38183: connect: Connection refused (error 111)
I20260811 10:02:36.870765 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 12160
I20260811 10:02:36.878909 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 11708
2026-08-11T10:02:36Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6493 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:36 dist-test-slave-1x4g krb5kdc[12506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:36 dist-test-slave-1x4g krb5kdc[12506](info): set up 2 sockets
Aug 11 10:02:36 dist-test-slave-1x4g krb5kdc[12506](info): commencing operation
krb5kdc: starting...
W20260811 10:02:37.953819 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:38.067754 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:45381
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:34819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:45381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:38.146721 12520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:38.146908 12520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:38.146929 12520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:38.147951 12520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:38.147984 12520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:38.147997 12520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:38.148010 12520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:38.148020 12520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:38.149365 12520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:45381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:45381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:38.149549 12520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:38.149703 12520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:38.154348 12528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:38.154387 12527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:38.154596 12520 server_base.cc:1034] running on GCE node
W20260811 10:02:38.154358 12530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:38.154877 12520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:38.155184 12520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:38.156347 12520 hybrid_clock.cc:648] HybridClock initialized: now 1786442558156342 us; error 37 us; skew 500 ppm
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:38.158855 12520 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:38.159268 12520 webserver.cc:460] Webserver started at http://127.9.127.254:46793/ using document root <none> and password file <none>
I20260811 10:02:38.159492 12520 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:38.159559 12520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:38.159708 12520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:38.160712 12520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "6ec5254e65314620b820d15592ec46e4"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "420d80eb1f191c513b618dabdf27de86"
server_key_iv: "7c813c1fe5ffcd32e3e0be07545a1fa9"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.161149 12520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "6ec5254e65314620b820d15592ec46e4"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "420d80eb1f191c513b618dabdf27de86"
server_key_iv: "7c813c1fe5ffcd32e3e0be07545a1fa9"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.162577 12520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:02:38.163246 12538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.163405 12520 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:38.163504 12520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6ec5254e65314620b820d15592ec46e4"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "420d80eb1f191c513b618dabdf27de86"
server_key_iv: "7c813c1fe5ffcd32e3e0be07545a1fa9"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.163584 12520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:38.182875 12520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:38.185235 12520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:38.185405 12520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:38.189405 12520 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:45381
I20260811 10:02:38.189442 12602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:45381 every 8 connection(s)
I20260811 10:02:38.189796 12520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:38.190794 12603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:38.192173 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 12520
I20260811 10:02:38.192276 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:38.192471 9727 external_mini_cluster.cc:1428] Setting key 6827aac13533367b114ba781f50df4ac
I20260811 10:02:38.193439 12603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4: Bootstrap starting.
I20260811 10:02:38.194307 12603 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:38.194671 12603 log.cc:824] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:38.195438 12603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4: No bootstrap required, opened a new log
I20260811 10:02:38.198058 12603 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec5254e65314620b820d15592ec46e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45381 } }
I20260811 10:02:38.198232 12603 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:38.198273 12603 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ec5254e65314620b820d15592ec46e4, State: Initialized, Role: FOLLOWER
I20260811 10:02:38.198415 12603 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec5254e65314620b820d15592ec46e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45381 } }
I20260811 10:02:38.198518 12603 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:38.198563 12603 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:38.198621 12603 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:38.199318 12603 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec5254e65314620b820d15592ec46e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45381 } }
I20260811 10:02:38.199411 12603 leader_election.cc:302] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ec5254e65314620b820d15592ec46e4; no voters:
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:38.199606 12603 leader_election.cc:288] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:38.199779 12611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:38.199887 12603 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:38.199954 12611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [term 1 LEADER]: Becoming Leader. State: Replica: 6ec5254e65314620b820d15592ec46e4, State: Running, Role: LEADER
I20260811 10:02:38.200101 12611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec5254e65314620b820d15592ec46e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45381 } }
I20260811 10:02:38.200508 12611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ec5254e65314620b820d15592ec46e4. Latest consensus state: current_term: 1 leader_uuid: "6ec5254e65314620b820d15592ec46e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec5254e65314620b820d15592ec46e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45381 } } }
I20260811 10:02:38.200524 12610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ec5254e65314620b820d15592ec46e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec5254e65314620b820d15592ec46e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45381 } } }
I20260811 10:02:38.200609 12611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:38.200626 12610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:38.200860 12619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:38.201412 12619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:38.203116 12619 catalog_manager.cc:1347] Generated new cluster ID: 8312b787fd9a4049aff3798e1d33f5c3
I20260811 10:02:38.203163 12619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:38.204886 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:38.193017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32964 (local address 127.9.127.254:45381)
0811 10:02:38.193183 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:38.193191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:38.193216 (+ 25us) server_negotiation.cc:407] Connection header received
0811 10:02:38.193660 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:38.193667 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:38.193713 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:38.193854 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:38.194788 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.195728 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.196870 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.197261 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.197339 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:38.200080 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:38.200085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:38.200085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:38.200097 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:38.203280 (+ 3183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:38.203652 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:38.203655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:38.203655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:38.203767 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:38.203996 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:38.203997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:38.203997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:38.204233 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:38.204409 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:38.204479 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 10:02:38.204658 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260811 10:02:38.212576 12619 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:38.213236 12619 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:38.220970 12619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ec5254e65314620b820d15592ec46e4: Generated new TSK 0
I20260811 10:02:38.221138 12619 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:38.250885 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45381
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:34819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:38.354161 12633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:38.354367 12633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:38.354391 12633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:38.355512 12633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:38.355558 12633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:38.355587 12633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:38.357105 12633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:38.357365 12633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:38.357617 12633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:38.363389 12639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:38.363405 12642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:38.363566 12633 server_base.cc:1034] running on GCE node
W20260811 10:02:38.363435 12640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:38.364115 12633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:38.364343 12633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:38.365509 12633 hybrid_clock.cc:648] HybridClock initialized: now 1786442558365490 us; error 41 us; skew 500 ppm
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:38.368449 12633 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:38.368930 12633 webserver.cc:460] Webserver started at http://127.9.127.193:39697/ using document root <none> and password file <none>
I20260811 10:02:38.369197 12633 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:38.369264 12633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:38.369405 12633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:38.370441 12633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "5bf697d93157407daa6b13fcd18076ef"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "abe50c7a615899a3a053174f94433d5f"
server_key_iv: "13c9b0f3cdc6e8ccfdf87f69adfa570a"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.370821 12633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "5bf697d93157407daa6b13fcd18076ef"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "abe50c7a615899a3a053174f94433d5f"
server_key_iv: "13c9b0f3cdc6e8ccfdf87f69adfa570a"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.372159 12633 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:38.372964 12651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.373157 12633 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:38.373257 12633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "5bf697d93157407daa6b13fcd18076ef"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "abe50c7a615899a3a053174f94433d5f"
server_key_iv: "13c9b0f3cdc6e8ccfdf87f69adfa570a"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.373338 12633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:38.382995 12633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:38.385290 12633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:38.385454 12633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:38.385679 12633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:38.385999 12633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:38.386055 12633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.386088 12633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:38.386116 12633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.392043 12633 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:37323
I20260811 10:02:38.392113 12782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:37323 every 8 connection(s)
I20260811 10:02:38.392424 12633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:38.396311 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 12633
I20260811 10:02:38.396400 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:38.396575 9727 external_mini_cluster.cc:1428] Setting key 81cf26504b72b3898a793d65be691775
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:38.401862 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:38.393190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:56647 (local address 127.9.127.254:45381)
0811 10:02:38.393252 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:38.393255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:38.393455 (+ 200us) server_negotiation.cc:407] Connection header received
0811 10:02:38.393892 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:38.393893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:38.393903 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:38.393952 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:38.394804 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.395286 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.396207 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.396539 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.396617 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:38.398982 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:38.398984 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:38.398984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:38.398991 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:38.400369 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:38.400806 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:38.400808 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:38.400808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:38.400877 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:38.401170 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:38.401171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:38.401171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:38.401287 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:38.401364 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:38.401685 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 10:02:38.401775 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:02:38.402034 12785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:38.393166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45381 (local address 127.9.127.193:56647)
0811 10:02:38.393339 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:38.393374 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:38.393815 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:38.394000 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:38.394003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:38.394541 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:38.394732 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:38.394736 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.395364 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.395364 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:38.396116 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:38.396118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.396665 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.396666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:38.396853 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:38.397358 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:38.397366 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:38.398880 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:38.400473 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:38.400481 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:38.400483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:38.400714 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:38.400971 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:38.400972 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:38.400972 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:38.401090 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:38.401357 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:38.401364 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:38.401531 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 10:02:38.401663 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 10:02:38.401813 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260811 10:02:38.402525 12783 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45381
I20260811 10:02:38.402632 12783 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:38.402827 12783 heartbeater.cc:511] Master 127.9.127.254:45381 requested a full tablet report, sending...
I20260811 10:02:38.403407 12559 ts_manager.cc:194] Registered new tserver with Master: 5bf697d93157407daa6b13fcd18076ef (127.9.127.193:37323)
I20260811 10:02:38.404320 12559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:56647
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:38.421849 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45381
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:34819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:38.502099 12788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:38.502290 12788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:38.502311 12788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:38.503293 12788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:38.503324 12788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:38.503347 12788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:38.504660 12788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:38.504928 12788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:38.505102 12788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:38.509718 12795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:38.509738 12794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:38.509758 12797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:38.510025 12788 server_base.cc:1034] running on GCE node
I20260811 10:02:38.510332 12788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:38.510617 12788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:38.511777 12788 hybrid_clock.cc:648] HybridClock initialized: now 1786442558511782 us; error 47 us; skew 500 ppm
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:38.514456 12788 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:38.514860 12788 webserver.cc:460] Webserver started at http://127.9.127.194:45271/ using document root <none> and password file <none>
I20260811 10:02:38.515084 12788 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:38.515151 12788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:38.515300 12788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:38.516377 12788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "76f19943d0e14e5d9535e436d552ce44"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "6f5dc1622cdd50084ded688fac9a22d3"
server_key_iv: "206ac8aa6d105ab456490308825a51f1"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.516752 12788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "76f19943d0e14e5d9535e436d552ce44"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "6f5dc1622cdd50084ded688fac9a22d3"
server_key_iv: "206ac8aa6d105ab456490308825a51f1"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.518102 12788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:38.518801 12805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.518950 12788 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:38.519054 12788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "76f19943d0e14e5d9535e436d552ce44"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "6f5dc1622cdd50084ded688fac9a22d3"
server_key_iv: "206ac8aa6d105ab456490308825a51f1"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.519138 12788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:38.527779 12788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:38.529929 12788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:38.530105 12788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:38.530336 12788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:38.530637 12788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:38.530694 12788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.530735 12788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:38.530764 12788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.536774 12788 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:40417
I20260811 10:02:38.536856 12938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:40417 every 8 connection(s)
I20260811 10:02:38.537143 12788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:38.545693 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:38.537832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:35415 (local address 127.9.127.254:45381)
0811 10:02:38.537918 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:38.537921 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:38.538059 (+ 138us) server_negotiation.cc:407] Connection header received
0811 10:02:38.538498 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:38.538499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:38.538509 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:38.538555 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:38.539396 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.539862 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.540817 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.541015 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.541068 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:38.542971 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:38.542973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:38.542973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:38.542980 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:38.544391 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:38.544755 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:38.544755 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:38.544756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:38.544917 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:38.545170 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:38.545171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:38.545171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:38.545274 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:38.545323 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:38.545572 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 10:02:38.545634 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 10:02:38.545851 12941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:38.537782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45381 (local address 127.9.127.194:35415)
0811 10:02:38.537948 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:38.537981 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:38.538423 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:38.538611 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:38.538613 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:38.539152 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:38.539326 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:38.539330 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.539938 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.539939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:38.540709 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:38.540712 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.541091 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.541091 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:38.541190 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:38.541604 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:38.541612 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:38.542885 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:38.544466 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:38.544472 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:38.544473 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:38.544680 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:38.544987 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:38.544988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:38.544988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:38.545112 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:38.545327 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:38.545332 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:38.545453 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 10:02:38.545546 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 10:02:38.545659 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":105,"threads_started":1}
I20260811 10:02:38.546348 12939 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45381
I20260811 10:02:38.546451 12939 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:38.546624 12939 heartbeater.cc:511] Master 127.9.127.254:45381 requested a full tablet report, sending...
I20260811 10:02:38.546661 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 12788
I20260811 10:02:38.546769 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:38.546976 9727 external_mini_cluster.cc:1428] Setting key 4577eb4806f77a2267c742a586b008f9
I20260811 10:02:38.547039 12559 ts_manager.cc:194] Registered new tserver with Master: 76f19943d0e14e5d9535e436d552ce44 (127.9.127.194:40417)
I20260811 10:02:38.547466 12559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:35415
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:38.572727 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45381
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:34819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:38.655087 12944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:38.655287 12944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:38.655310 12944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:38.656371 12944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:38.656404 12944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:38.656430 12944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:38.657833 12944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:38.658027 12944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:38.658195 12944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:38.663194 12951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:38.663311 12956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:38.663408 12944 server_base.cc:1034] running on GCE node
W20260811 10:02:38.663223 12950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:38.663717 12944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:38.663956 12944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:38.665097 12944 hybrid_clock.cc:648] HybridClock initialized: now 1786442558665076 us; error 35 us; skew 500 ppm
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:38.667764 12944 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:38.668241 12944 webserver.cc:460] Webserver started at http://127.9.127.195:41005/ using document root <none> and password file <none>
I20260811 10:02:38.668471 12944 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:38.668517 12944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:38.668663 12944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:38.669735 12944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "bcc00d3c8e7e44bbad16fb3be9b3a683"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "b5174c865753e7a15f61f5a822c0004f"
server_key_iv: "fd2d10aa7e36067f5ff3deb54af1e4f4"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.670083 12944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "bcc00d3c8e7e44bbad16fb3be9b3a683"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "b5174c865753e7a15f61f5a822c0004f"
server_key_iv: "fd2d10aa7e36067f5ff3deb54af1e4f4"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.671414 12944 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:02:38.672142 12965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.672326 12944 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:38.672420 12944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "bcc00d3c8e7e44bbad16fb3be9b3a683"
format_stamp: "Formatted at 2026-08-11 10:02:38 on dist-test-slave-1x4g"
server_key: "b5174c865753e7a15f61f5a822c0004f"
server_key_iv: "fd2d10aa7e36067f5ff3deb54af1e4f4"
server_key_version: "encryptionkey@0"
I20260811 10:02:38.672502 12944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:38.683187 12944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:38.684957 12944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:38.685109 12944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:38.685331 12944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:38.685647 12944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:38.685680 12944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.685700 12944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:38.685745 12944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:38.691452 12944 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:44235
I20260811 10:02:38.691618 13091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:44235 every 8 connection(s)
I20260811 10:02:38.691880 12944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[12506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442558, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:38.698221 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 12944
I20260811 10:02:38.698347 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:38.698580 9727 external_mini_cluster.cc:1428] Setting key 9f3d66ac7d79cd8b754bdf8208ea2a65
I20260811 10:02:38.701557 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:38.692629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:45513 (local address 127.9.127.254:45381)
0811 10:02:38.692705 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:38.692707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:38.692843 (+ 136us) server_negotiation.cc:407] Connection header received
0811 10:02:38.693347 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:38.693348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:38.693358 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:38.693406 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:38.694311 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.694804 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.695830 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.696044 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.696104 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:38.698335 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:38.698336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:38.698337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:38.698344 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:38.700005 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:38.700447 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:38.700448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:38.700448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:38.700512 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:38.700860 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:38.700861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:38.700861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:38.701002 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:38.701058 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:38.701372 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 10:02:38.701438 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 10:02:38.701651 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:38.692572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45381 (local address 127.9.127.195:45513)
0811 10:02:38.692731 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:38.692769 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:38.693240 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:38.693465 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:38.693468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:38.694035 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:38.694236 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:38.694241 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.694900 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.694900 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:38.695734 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:38.695736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:38.696129 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:38.696130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:38.696229 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:38.696792 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:38.696801 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:38.698221 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:38.700103 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:38.700111 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:38.700113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:38.700349 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:38.700611 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:38.700612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:38.700612 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:38.700760 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:38.701069 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:38.701081 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:38.701249 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 10:02:38.701330 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 10:02:38.701471 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260811 10:02:38.702061 13092 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45381
I20260811 10:02:38.702163 13092 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:38.702346 13092 heartbeater.cc:511] Master 127.9.127.254:45381 requested a full tablet report, sending...
I20260811 10:02:38.702718 12558 ts_manager.cc:194] Registered new tserver with Master: bcc00d3c8e7e44bbad16fb3be9b3a683 (127.9.127.195:44235)
I20260811 10:02:38.703102 12558 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:45513
I20260811 10:02:38.710430 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 10:02:38.723995 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:38.723132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32976 (local address 127.9.127.254:45381)
0811 10:02:38.723196 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:38.723198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:38.723311 (+ 113us) server_negotiation.cc:407] Connection header received
0811 10:02:38.723372 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:38.723373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:38.723382 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:38.723441 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:38.723938 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32976: BlockingRecv error: recv got EOF from 127.0.0.1:32976 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:02:38.724861 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 12633
I20260811 10:02:38.732170 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 12788
I20260811 10:02:38.740042 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 12944
I20260811 10:02:38.745782 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 12520
2026-08-11T10:02:38Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1866 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[13106](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[13106](info): set up 2 sockets
Aug 11 10:02:38 dist-test-slave-1x4g krb5kdc[13106](info): commencing operation
krb5kdc: starting...
W20260811 10:02:39.820343 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:39 dist-test-slave-1x4g krb5kdc[13106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:39.939409 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:39717
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:39717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:40.023144 13119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:40.023347 13119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:40.023371 13119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:40.024528 13119 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:40.024573 13119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:40.024590 13119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:40.024628 13119 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:40.024658 13119 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:40.026188 13119 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:39717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:39717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:40.026450 13119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:40.026695 13119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:40.031711 13126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:40.031737 13125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:40.031751 13129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:40.031983 13119 server_base.cc:1034] running on GCE node
I20260811 10:02:40.032205 13119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:40.032497 13119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:40.033636 13119 hybrid_clock.cc:648] HybridClock initialized: now 1786442560033625 us; error 27 us; skew 500 ppm
Aug 11 10:02:40 dist-test-slave-1x4g krb5kdc[13106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442560, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:40.042572 13119 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:40.043013 13119 webserver.cc:460] Webserver started at http://127.9.127.254:36569/ using document root <none> and password file <none>
I20260811 10:02:40.043262 13119 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:40.043330 13119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:40.043483 13119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:40.044567 13119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "cd708725017c4861b5bd246e3a5a4ad4"
format_stamp: "Formatted at 2026-08-11 10:02:40 on dist-test-slave-1x4g"
server_key: "20698777f34d0d40d030d1c4aa096955"
server_key_iv: "9adcd65f9f6a43d26ab3244daf5b12f2"
server_key_version: "encryptionkey@0"
I20260811 10:02:40.044992 13119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "cd708725017c4861b5bd246e3a5a4ad4"
format_stamp: "Formatted at 2026-08-11 10:02:40 on dist-test-slave-1x4g"
server_key: "20698777f34d0d40d030d1c4aa096955"
server_key_iv: "9adcd65f9f6a43d26ab3244daf5b12f2"
server_key_version: "encryptionkey@0"
I20260811 10:02:40.046326 13119 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:40.047061 13138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:40.047233 13119 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:40.047340 13119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "cd708725017c4861b5bd246e3a5a4ad4"
format_stamp: "Formatted at 2026-08-11 10:02:40 on dist-test-slave-1x4g"
server_key: "20698777f34d0d40d030d1c4aa096955"
server_key_iv: "9adcd65f9f6a43d26ab3244daf5b12f2"
server_key_version: "encryptionkey@0"
I20260811 10:02:40.047417 13119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:40.065761 13119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:40.067596 13119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:40.067754 13119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:40.072189 13119 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:39717
I20260811 10:02:40.072237 13200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:39717 every 8 connection(s)
I20260811 10:02:40.072656 13119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:40.073598 13201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:40.074443 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 13119
I20260811 10:02:40.074550 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:40.074728 9727 external_mini_cluster.cc:1428] Setting key 0a43ad5dd967276afa1afbee8023437f
I20260811 10:02:40.076884 13201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4: Bootstrap starting.
I20260811 10:02:40.077535 13201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:40.077819 13201 log.cc:824] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:40.078505 13201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4: No bootstrap required, opened a new log
I20260811 10:02:40.080446 13201 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd708725017c4861b5bd246e3a5a4ad4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39717 } }
I20260811 10:02:40.080662 13201 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:40.080703 13201 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd708725017c4861b5bd246e3a5a4ad4, State: Initialized, Role: FOLLOWER
I20260811 10:02:40.080850 13201 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd708725017c4861b5bd246e3a5a4ad4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39717 } }
I20260811 10:02:40.080946 13201 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:40.080987 13201 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:40.081038 13201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 10:02:40 dist-test-slave-1x4g krb5kdc[13106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:40.081676 13201 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd708725017c4861b5bd246e3a5a4ad4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39717 } }
I20260811 10:02:40.081794 13201 leader_election.cc:302] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd708725017c4861b5bd246e3a5a4ad4; no voters:
I20260811 10:02:40.081987 13201 leader_election.cc:288] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:40.082026 13207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:40.082245 13201 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:40.082422 13207 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [term 1 LEADER]: Becoming Leader. State: Replica: cd708725017c4861b5bd246e3a5a4ad4, State: Running, Role: LEADER
I20260811 10:02:40.082579 13207 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd708725017c4861b5bd246e3a5a4ad4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39717 } }
I20260811 10:02:40.083016 13207 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd708725017c4861b5bd246e3a5a4ad4. Latest consensus state: current_term: 1 leader_uuid: "cd708725017c4861b5bd246e3a5a4ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd708725017c4861b5bd246e3a5a4ad4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39717 } } }
I20260811 10:02:40.083056 13209 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd708725017c4861b5bd246e3a5a4ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd708725017c4861b5bd246e3a5a4ad4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39717 } } }
I20260811 10:02:40.083273 13209 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:40.083145 13207 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:40.083585 13222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:40.084144 13222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:40.086031 13205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:40.075247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42232 (local address 127.9.127.254:39717)
0811 10:02:40.075422 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:40.075429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:40.075454 (+ 25us) server_negotiation.cc:407] Connection header received
0811 10:02:40.075870 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:40.075877 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:40.075921 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:40.076030 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:40.076877 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:40.077850 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:40.078605 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:40.079023 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:40.079162 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:40.081792 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:40.081796 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:40.081797 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:40.081809 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:40.084105 (+ 2296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:40.084583 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:40.084586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:40.084586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:40.084693 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:40.084944 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:40.084945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:40.084946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:40.085275 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:40.085416 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:40.085696 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 10:02:40.085848 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
I20260811 10:02:40.086773 13222 catalog_manager.cc:1347] Generated new cluster ID: fb7c9f2fd3314749b69b261b0d768db9
I20260811 10:02:40.086831 13222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:40.087033 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:02:40.095137 13222 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:40.095799 13222 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:40.106940 13205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:40.103680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42238 (local address 127.9.127.254:39717)
0811 10:02:40.103729 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:40.103731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:40.103819 (+ 88us) server_negotiation.cc:407] Connection header received
0811 10:02:40.103899 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:40.103900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:40.103910 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:40.103987 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:40.104358 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:40.104889 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:40.105598 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:40.105800 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:40.105867 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:40.106519 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:40.106520 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:40.106520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:40.106694 (+ 174us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:40.106708 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:40.106714 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:40.106772 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:40.106841 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 10:02:40.106865 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 10:02:40.108537 13222 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd708725017c4861b5bd246e3a5a4ad4: Generated new TSK 0
I20260811 10:02:40.108706 13222 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:02:40.115589 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 13119
2026-08-11T10:02:40Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1369 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:40 dist-test-slave-1x4g krb5kdc[13239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:40 dist-test-slave-1x4g krb5kdc[13239](info): set up 2 sockets
Aug 11 10:02:40 dist-test-slave-1x4g krb5kdc[13239](info): commencing operation
krb5kdc: starting...
W20260811 10:02:41.189424 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:41.306890 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35983
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:34181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:35983
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:41.385522 13254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:41.385748 13254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:41.385783 13254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:41.386866 13254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:41.386933 13254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:41.386958 13254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:41.386993 13254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:41.387017 13254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:41.388430 13254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:35983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:41.388682 13254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:41.388926 13254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:41.393590 13259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:41.393625 13260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:41.393635 13262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:41.393747 13254 server_base.cc:1034] running on GCE node
I20260811 10:02:41.394001 13254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:41.394268 13254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:41.395404 13254 hybrid_clock.cc:648] HybridClock initialized: now 1786442561395388 us; error 37 us; skew 500 ppm
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:41.397843 13254 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:41.398303 13254 webserver.cc:460] Webserver started at http://127.9.127.254:36959/ using document root <none> and password file <none>
I20260811 10:02:41.398491 13254 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:41.398530 13254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:41.398613 13254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:41.399546 13254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "3db688a726534c3f981170168926ac02"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "c69acf88619106acf3e07b6ac16c100a"
server_key_iv: "57553a83dac5c86aedcea73fe48d2ccc"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.399838 13254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "3db688a726534c3f981170168926ac02"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "c69acf88619106acf3e07b6ac16c100a"
server_key_iv: "57553a83dac5c86aedcea73fe48d2ccc"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.401262 13254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:41.401988 13271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.402153 13254 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:41.402241 13254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "3db688a726534c3f981170168926ac02"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "c69acf88619106acf3e07b6ac16c100a"
server_key_iv: "57553a83dac5c86aedcea73fe48d2ccc"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.402297 13254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:41.416935 13254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:41.419116 13254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:41.419224 13254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:41.423255 13254 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:35983
I20260811 10:02:41.423322 13328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:35983 every 8 connection(s)
I20260811 10:02:41.423650 13254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:41.424901 13329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:41.427098 13329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02: Bootstrap starting.
I20260811 10:02:41.427668 13329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:41.427953 13329 log.cc:824] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:41.428648 13329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02: No bootstrap required, opened a new log
I20260811 10:02:41.430213 13329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db688a726534c3f981170168926ac02" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35983 } }
I20260811 10:02:41.430367 13329 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:41.430413 13329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3db688a726534c3f981170168926ac02, State: Initialized, Role: FOLLOWER
I20260811 10:02:41.430622 13329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db688a726534c3f981170168926ac02" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35983 } }
I20260811 10:02:41.430724 13329 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:41.430771 13329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:41.430825 13329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:41.431463 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 13254
I20260811 10:02:41.431548 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:41.431716 13329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db688a726534c3f981170168926ac02" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35983 } }
I20260811 10:02:41.431742 9727 external_mini_cluster.cc:1428] Setting key ecb0e5a24bbb2c86d9ca5140eb463a20
I20260811 10:02:41.431836 13329 leader_election.cc:302] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3db688a726534c3f981170168926ac02; no voters:
I20260811 10:02:41.432004 13329 leader_election.cc:288] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:41.432021 13333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:41.432138 13333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [term 1 LEADER]: Becoming Leader. State: Replica: 3db688a726534c3f981170168926ac02, State: Running, Role: LEADER
I20260811 10:02:41.432255 13329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:41.432236 13333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db688a726534c3f981170168926ac02" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35983 } }
I20260811 10:02:41.432669 13335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3db688a726534c3f981170168926ac02. Latest consensus state: current_term: 1 leader_uuid: "3db688a726534c3f981170168926ac02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db688a726534c3f981170168926ac02" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35983 } } }
I20260811 10:02:41.432951 13335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:41.432875 13334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3db688a726534c3f981170168926ac02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db688a726534c3f981170168926ac02" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35983 } } }
I20260811 10:02:41.433203 13334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:41.433598 13344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:41.434302 13344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:41.435793 13344 catalog_manager.cc:1347] Generated new cluster ID: 0f90efcf08e741bcb99dca894ba896e0
I20260811 10:02:41.435846 13344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:41.442493 13337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:41.432240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33570 (local address 127.9.127.254:35983)
0811 10:02:41.432639 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:41.432649 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:41.432691 (+ 42us) server_negotiation.cc:407] Connection header received
0811 10:02:41.432883 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:41.432891 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:41.432952 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:41.433105 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:41.434045 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.435377 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.436275 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.436764 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.436913 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:41.439216 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:41.439220 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:41.439220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:41.439232 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:41.440966 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.441342 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.441345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.441346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.441449 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.441695 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.441696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.441696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.441904 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:41.442078 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:41.442144 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 10:02:41.442276 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":67,"threads_started":1}
I20260811 10:02:41.455611 13344 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:41.456117 13344 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:41.459570 13344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3db688a726534c3f981170168926ac02: Generated new TSK 0
I20260811 10:02:41.459743 13344 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:41.493094 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35983
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:34181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:41.574314 13357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:41.574510 13357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:41.574532 13357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:41.575630 13357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:41.575668 13357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:41.575693 13357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:41.577198 13357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:41.577435 13357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:41.577623 13357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:41.582616 13366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:41.582679 13364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:41.582719 13357 server_base.cc:1034] running on GCE node
W20260811 10:02:41.582617 13363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:41.583062 13357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:41.583364 13357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:41.584524 13357 hybrid_clock.cc:648] HybridClock initialized: now 1786442561584508 us; error 56 us; skew 500 ppm
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:41.587041 13357 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:41.587493 13357 webserver.cc:460] Webserver started at http://127.9.127.193:37199/ using document root <none> and password file <none>
I20260811 10:02:41.587750 13357 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:41.587821 13357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:41.587971 13357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:41.589107 13357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "f31dc3acb2314de883c6612363d12deb"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "d8b5751e223d3600ad3903b7a9709a97"
server_key_iv: "b23b169f7a4b3f09396bae9525516100"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.589473 13357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "f31dc3acb2314de883c6612363d12deb"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "d8b5751e223d3600ad3903b7a9709a97"
server_key_iv: "b23b169f7a4b3f09396bae9525516100"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.590972 13357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:41.591714 13374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.591899 13357 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:41.592006 13357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "f31dc3acb2314de883c6612363d12deb"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "d8b5751e223d3600ad3903b7a9709a97"
server_key_iv: "b23b169f7a4b3f09396bae9525516100"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.592079 13357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:41.604497 13357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:41.606442 13357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:41.606599 13357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:41.606824 13357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:41.607149 13357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:41.607203 13357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.607237 13357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:41.607264 13357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.612927 13357 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:35317
I20260811 10:02:41.613003 13498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:35317 every 8 connection(s)
I20260811 10:02:41.613335 13357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:41.617961 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 13357
I20260811 10:02:41.618096 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:41.618304 9727 external_mini_cluster.cc:1428] Setting key f29f5f3408171c2a8713299d835ab0bd
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:41.623334 13337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:41.614065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:57929 (local address 127.9.127.254:35983)
0811 10:02:41.614109 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:41.614111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:41.614339 (+ 228us) server_negotiation.cc:407] Connection header received
0811 10:02:41.614923 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:41.614925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:41.614941 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:41.614987 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:41.615971 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.616490 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.617619 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.617882 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.617960 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:41.620332 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:41.620333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:41.620334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:41.620343 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:41.621820 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.622258 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.622259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.622259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.622325 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.622599 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.622600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.622601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.622714 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:41.622793 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:41.623157 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 10:02:41.623244 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 10:02:41.623474 13503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:41.614037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35983 (local address 127.9.127.193:57929)
0811 10:02:41.614225 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:41.614260 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:41.614806 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:41.615100 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:41.615103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:41.615679 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:41.615864 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:41.615869 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.616596 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.616598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:41.617500 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:41.617503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.617976 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.617977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:41.618160 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:41.618729 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:41.618739 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:41.620232 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:41.621923 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:41.621931 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:41.621933 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:41.622161 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:41.622400 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:41.622401 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:41.622401 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:41.622512 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:41.622783 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:41.622791 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:41.622935 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 10:02:41.623063 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 10:02:41.623247 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":98,"threads_started":1}
I20260811 10:02:41.623922 13500 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35983
I20260811 10:02:41.624018 13500 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:41.624221 13500 heartbeater.cc:511] Master 127.9.127.254:35983 requested a full tablet report, sending...
I20260811 10:02:41.624763 13289 ts_manager.cc:194] Registered new tserver with Master: f31dc3acb2314de883c6612363d12deb (127.9.127.193:35317)
I20260811 10:02:41.625407 13289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:57929
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:41.643338 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35983
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:34181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:41.724762 13506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:41.725054 13506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:41.725090 13506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:41.726262 13506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:41.726330 13506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:41.726377 13506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:41.727847 13506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:41.728123 13506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:41.728351 13506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:41.733345 13516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:41.733333 13512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:41.733316 13511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:41.733676 13506 server_base.cc:1034] running on GCE node
I20260811 10:02:41.733891 13506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:41.734177 13506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:41.735338 13506 hybrid_clock.cc:648] HybridClock initialized: now 1786442561735321 us; error 40 us; skew 500 ppm
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:41.737990 13506 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:41.738354 13506 webserver.cc:460] Webserver started at http://127.9.127.194:36103/ using document root <none> and password file <none>
I20260811 10:02:41.738592 13506 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:41.738637 13506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:41.738785 13506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:41.739771 13506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "34569174eac248a29ddabad6a8ee0568"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "ab3fc70bfa194e1056a0437bd13f98f8"
server_key_iv: "83a92636c2327fad3643e57a46a45b23"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.740131 13506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "34569174eac248a29ddabad6a8ee0568"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "ab3fc70bfa194e1056a0437bd13f98f8"
server_key_iv: "83a92636c2327fad3643e57a46a45b23"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.741524 13506 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 10:02:41.742251 13523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.742449 13506 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:41.742547 13506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "34569174eac248a29ddabad6a8ee0568"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "ab3fc70bfa194e1056a0437bd13f98f8"
server_key_iv: "83a92636c2327fad3643e57a46a45b23"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.742655 13506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:41.755497 13506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:41.757361 13506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:41.757519 13506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:41.757769 13506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:41.758124 13506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:41.758184 13506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.758219 13506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:41.758236 13506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.764645 13506 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:39077
I20260811 10:02:41.764689 13645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:39077 every 8 connection(s)
I20260811 10:02:41.765046 13506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:41.768054 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 13506
I20260811 10:02:41.768165 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:41.768326 9727 external_mini_cluster.cc:1428] Setting key 8115ed21d033643a7c8a6951fb15b2d2
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:41.775274 13337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:41.765773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:32867 (local address 127.9.127.254:35983)
0811 10:02:41.765830 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:41.765832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:41.766041 (+ 209us) server_negotiation.cc:407] Connection header received
0811 10:02:41.766594 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:41.766595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:41.766605 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:41.766663 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:41.767621 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.768381 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.769696 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.770010 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.770084 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:41.772416 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:41.772418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:41.772418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:41.772426 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:41.773896 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.774325 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.774326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.774327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.774386 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.774632 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.774633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.774633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.774745 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:41.774813 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:41.775105 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 10:02:41.775185 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 10:02:41.775467 13648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:41.765721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35983 (local address 127.9.127.194:32867)
0811 10:02:41.765906 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:41.765949 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:41.766505 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:41.766736 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:41.766739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:41.767327 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:41.767539 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:41.767544 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.768524 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.768525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:41.769593 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:41.769596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.770104 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.770105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:41.770218 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:41.770804 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:41.770815 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:41.772320 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:41.773997 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:41.774005 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:41.774007 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:41.774233 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:41.774450 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:41.774451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:41.774451 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:41.774564 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:41.774818 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:41.774825 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:41.774959 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 10:02:41.775080 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 10:02:41.775238 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":105,"threads_started":1}
I20260811 10:02:41.775949 13646 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35983
I20260811 10:02:41.776031 13646 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:41.776216 13646 heartbeater.cc:511] Master 127.9.127.254:35983 requested a full tablet report, sending...
I20260811 10:02:41.776645 13289 ts_manager.cc:194] Registered new tserver with Master: 34569174eac248a29ddabad6a8ee0568 (127.9.127.194:39077)
I20260811 10:02:41.777066 13289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:32867
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:41.795917 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35983
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:34181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:41.877607 13651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:41.877792 13651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:41.877815 13651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:41.878865 13651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:41.878902 13651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:41.878925 13651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:41.880472 13651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:41.880728 13651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:41.880980 13651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:41.885712 13660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:41.885721 13661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:41.885721 13663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:41.886116 13651 server_base.cc:1034] running on GCE node
I20260811 10:02:41.886333 13651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:41.886617 13651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:41.887789 13651 hybrid_clock.cc:648] HybridClock initialized: now 1786442561887786 us; error 39 us; skew 500 ppm
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:41.890311 13651 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:41.890744 13651 webserver.cc:460] Webserver started at http://127.9.127.195:35007/ using document root <none> and password file <none>
I20260811 10:02:41.890980 13651 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:41.891048 13651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:41.891215 13651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:41.892207 13651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "a32d3dd3035d451d9dd6cc86f7e9118c"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "f1a8f467d324873905926c9733980712"
server_key_iv: "e48843ef30abaf558e8fa3784e77e827"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.892563 13651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "a32d3dd3035d451d9dd6cc86f7e9118c"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "f1a8f467d324873905926c9733980712"
server_key_iv: "e48843ef30abaf558e8fa3784e77e827"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.893888 13651 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:41.894663 13670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.894825 13651 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:41.894942 13651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "a32d3dd3035d451d9dd6cc86f7e9118c"
format_stamp: "Formatted at 2026-08-11 10:02:41 on dist-test-slave-1x4g"
server_key: "f1a8f467d324873905926c9733980712"
server_key_iv: "e48843ef30abaf558e8fa3784e77e827"
server_key_version: "encryptionkey@0"
I20260811 10:02:41.895012 13651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:41.908255 13651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:41.910470 13651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:41.910681 13651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:41.910916 13651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:41.911237 13651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:41.911291 13651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.911325 13651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:41.911352 13651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:41.917343 13651 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:46591
I20260811 10:02:41.917503 13792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:46591 every 8 connection(s)
I20260811 10:02:41.917783 13651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:41.920995 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 13651
I20260811 10:02:41.921118 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:41.921290 9727 external_mini_cluster.cc:1428] Setting key db82de4df90ead132fb846bd19b22d38
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:41.927431 13337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:41.918577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:52357 (local address 127.9.127.254:35983)
0811 10:02:41.918641 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:41.918643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:41.918863 (+ 220us) server_negotiation.cc:407] Connection header received
0811 10:02:41.919404 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:41.919405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:41.919419 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:41.919475 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:41.920428 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.921020 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.922445 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.922647 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.922722 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:41.924911 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:41.924912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:41.924912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:41.924919 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:41.926257 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.926596 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.926597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.926597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.926648 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.926903 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.926904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.926904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.926998 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:41.927046 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:41.927311 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 10:02:41.927372 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 10:02:41.927587 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:41.918538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35983 (local address 127.9.127.195:52357)
0811 10:02:41.918735 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:41.918777 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:41.919292 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:41.919542 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:41.919546 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:41.920128 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:41.920319 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:41.920325 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.921122 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.921123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:41.922352 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:41.922356 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.922743 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.922744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:41.922892 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:41.923387 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:41.923400 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:41.924768 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:41.926324 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:41.926330 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:41.926331 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:41.926528 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:41.926730 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:41.926731 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:41.926731 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:41.926840 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:41.927079 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:41.927085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:41.927200 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 10:02:41.927283 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 10:02:41.927394 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260811 10:02:41.928033 13793 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35983
I20260811 10:02:41.928148 13793 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:41.928321 13793 heartbeater.cc:511] Master 127.9.127.254:35983 requested a full tablet report, sending...
I20260811 10:02:41.928678 13289 ts_manager.cc:194] Registered new tserver with Master: a32d3dd3035d451d9dd6cc86f7e9118c (127.9.127.195:46591)
I20260811 10:02:41.929054 13289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:52357
I20260811 10:02:41.933061 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 10:02:41 dist-test-slave-1x4g krb5kdc[13239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442561, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:41.957070 13337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:41.950589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33576 (local address 127.9.127.254:35983)
0811 10:02:41.950668 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:41.950670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:41.950704 (+ 34us) server_negotiation.cc:407] Connection header received
0811 10:02:41.950755 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:41.950756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:41.950765 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:41.950812 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:41.951299 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.951774 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.952433 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:41.952601 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:41.952648 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:41.954835 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:41.954836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:41.954837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:41.954843 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:41.956012 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.956310 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.956310 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.956311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.956358 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:41.956517 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:41.956518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:41.956518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:41.956659 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:41.956734 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:41.956899 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 10:02:41.956969 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 10:02:41.957333 13289 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33576
I20260811 10:02:41.957742 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 13357
I20260811 10:02:41.964459 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 13506
I20260811 10:02:41.973165 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 13651
I20260811 10:02:41.979594 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 13254
2026-08-11T10:02:41Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1864 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:42 dist-test-slave-1x4g krb5kdc[13808](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:42 dist-test-slave-1x4g krb5kdc[13808](info): set up 2 sockets
Aug 11 10:02:42 dist-test-slave-1x4g krb5kdc[13808](info): commencing operation
krb5kdc: starting...
W20260811 10:02:43.057296 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:43.174921 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:44613
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:44613
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:43.254737 13821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:43.254990 13821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:43.255028 13821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:43.256184 13821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:43.256245 13821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:43.256268 13821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:43.256287 13821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:43.256314 13821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:43.258111 13821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:44613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:44613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:43.258354 13821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:43.258585 13821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:43.263278 13829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:43.263321 13827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:43.263307 13821 server_base.cc:1034] running on GCE node
W20260811 10:02:43.263278 13826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:43.263739 13821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:43.264010 13821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:43.265142 13821 hybrid_clock.cc:648] HybridClock initialized: now 1786442563265132 us; error 27 us; skew 500 ppm
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:43.267542 13821 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:43.267941 13821 webserver.cc:460] Webserver started at http://127.9.127.254:40215/ using document root <none> and password file <none>
I20260811 10:02:43.268160 13821 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:43.268226 13821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:43.268371 13821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:43.269426 13821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "610bfc9a17c559ba45f0833741f51bce"
server_key_iv: "a0f0ef8e488712df70e266cd9e1ce3f1"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.269788 13821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "610bfc9a17c559ba45f0833741f51bce"
server_key_iv: "a0f0ef8e488712df70e266cd9e1ce3f1"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.271111 13821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:02:43.271809 13837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.271992 13821 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:43.272105 13821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "610bfc9a17c559ba45f0833741f51bce"
server_key_iv: "a0f0ef8e488712df70e266cd9e1ce3f1"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.272177 13821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:43.293838 13821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:43.296149 13821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:43.296315 13821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:43.300550 13821 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:44613
I20260811 10:02:43.300604 13893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:44613 every 8 connection(s)
I20260811 10:02:43.301244 13821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:43.302008 13894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:43.304209 13894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4: Bootstrap starting.
I20260811 10:02:43.304774 13894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:43.305140 13894 log.cc:824] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:43.305763 13894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4: No bootstrap required, opened a new log
I20260811 10:02:43.307211 13894 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 44613 } }
I20260811 10:02:43.307340 13894 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:43.307363 13894 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ce6f7bf984345ba8cc20a94eb0f35e4, State: Initialized, Role: FOLLOWER
I20260811 10:02:43.307514 13894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 44613 } }
I20260811 10:02:43.307595 13894 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:43.307617 13894 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:43.307643 13894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:43.308396 13894 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 44613 } }
I20260811 10:02:43.308485 13894 leader_election.cc:302] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ce6f7bf984345ba8cc20a94eb0f35e4; no voters:
I20260811 10:02:43.308626 13894 leader_election.cc:288] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:43.308665 13897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:43.308800 13897 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [term 1 LEADER]: Becoming Leader. State: Replica: 8ce6f7bf984345ba8cc20a94eb0f35e4, State: Running, Role: LEADER
I20260811 10:02:43.308890 13894 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:43.308915 13897 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 44613 } }
I20260811 10:02:43.309327 13898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 44613 } } }
I20260811 10:02:43.309376 13899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ce6f7bf984345ba8cc20a94eb0f35e4. Latest consensus state: current_term: 1 leader_uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ce6f7bf984345ba8cc20a94eb0f35e4" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 44613 } } }
I20260811 10:02:43.309508 13898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:43.309520 13899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:43.309993 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 13821
I20260811 10:02:43.310117 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:43.310148 13906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:43.310314 9727 external_mini_cluster.cc:1428] Setting key 4b21d6b03def73906fdaa91d6bdf31e4
I20260811 10:02:43.310758 13906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:43.312379 13906 catalog_manager.cc:1347] Generated new cluster ID: 440ebd452b3745e8a5ec8dde710f2469
I20260811 10:02:43.312434 13906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:43.320566 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.310979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48312 (local address 127.9.127.254:44613)
0811 10:02:43.311153 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:43.311162 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:43.311193 (+ 31us) server_negotiation.cc:407] Connection header received
0811 10:02:43.311309 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:43.311316 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:43.311368 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:43.311500 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:43.312343 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.313376 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.314073 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.314499 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.314614 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.316866 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:43.316870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:43.316871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:43.316888 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:43.318941 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.319354 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.319357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.319358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.319459 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.319675 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.319676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.319676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.319906 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:43.320073 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:43.320167 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 10:02:43.320412 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260811 10:02:43.328588 13906 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:43.329231 13906 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:43.338910 13906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ce6f7bf984345ba8cc20a94eb0f35e4: Generated new TSK 0
I20260811 10:02:43.339068 13906 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:43.367496 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:44613
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:43.448618 13922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:43.448851 13922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:43.448891 13922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:43.450006 13922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:43.450069 13922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:43.450111 13922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:43.451614 13922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:44613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:43.451887 13922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:43.452121 13922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:43.457039 13929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:43.457079 13932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:43.457093 13922 server_base.cc:1034] running on GCE node
W20260811 10:02:43.457059 13927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:43.457587 13922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:43.457794 13922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:43.459003 13922 hybrid_clock.cc:648] HybridClock initialized: now 1786442563458986 us; error 43 us; skew 500 ppm
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:43.461683 13922 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:43.462316 13922 webserver.cc:460] Webserver started at http://127.9.127.193:45329/ using document root <none> and password file <none>
I20260811 10:02:43.462546 13922 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:43.462616 13922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:43.462771 13922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:43.463792 13922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "57be06d124064830b13ce402fa92d86e"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "4dbffd140c20ce24801b2c0026365bf8"
server_key_iv: "b934a3b0cfd270f011d34155afbb8524"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.464169 13922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "57be06d124064830b13ce402fa92d86e"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "4dbffd140c20ce24801b2c0026365bf8"
server_key_iv: "b934a3b0cfd270f011d34155afbb8524"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.465595 13922 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:43.466317 13939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.466487 13922 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:43.466593 13922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "57be06d124064830b13ce402fa92d86e"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "4dbffd140c20ce24801b2c0026365bf8"
server_key_iv: "b934a3b0cfd270f011d34155afbb8524"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.466665 13922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:43.480881 13922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:43.482666 13922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:43.482824 13922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:43.483050 13922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:43.483354 13922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:43.483407 13922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.483446 13922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:43.483470 13922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.489391 13922 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:43259
I20260811 10:02:43.489471 14072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:43259 every 8 connection(s)
I20260811 10:02:43.489777 13922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:43.492525 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 13922
I20260811 10:02:43.492650 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:43.492897 9727 external_mini_cluster.cc:1428] Setting key 6795d73e260ae40eaa31062a0c1c71d2
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:43.499833 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.490474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:53857 (local address 127.9.127.254:44613)
0811 10:02:43.490534 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:43.490536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:43.490733 (+ 197us) server_negotiation.cc:407] Connection header received
0811 10:02:43.491668 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:43.491669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:43.491683 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:43.491747 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:43.492335 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.493001 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.494398 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.494596 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.494651 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.496999 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:43.497000 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:43.497001 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:43.497008 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:43.498457 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.498866 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.498867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.498868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.498930 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.499200 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.499201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.499201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.499317 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:43.499391 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:43.499656 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 10:02:43.499750 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:02:43.499989 14075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.490421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:44613 (local address 127.9.127.193:53857)
0811 10:02:43.490589 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:43.490633 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:43.491549 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:43.491835 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:43.491839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:43.492082 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:43.492259 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:43.492263 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.493116 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.493117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:43.494310 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:43.494314 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.494680 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.494681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:43.494865 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.495365 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:43.495377 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:43.496903 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:43.498559 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:43.498567 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:43.498569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:43.498789 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:43.499004 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:43.499004 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:43.499005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:43.499122 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:43.499383 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:43.499391 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:43.499519 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 10:02:43.499620 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 10:02:43.499777 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260811 10:02:43.500454 14073 heartbeater.cc:347] Connected to a master server at 127.9.127.254:44613
I20260811 10:02:43.500535 14073 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:43.500830 14073 heartbeater.cc:511] Master 127.9.127.254:44613 requested a full tablet report, sending...
I20260811 10:02:43.501430 13855 ts_manager.cc:194] Registered new tserver with Master: 57be06d124064830b13ce402fa92d86e (127.9.127.193:43259)
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
I20260811 10:02:43.502154 13855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:53857
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:43.519757 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:44613
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:43.599460 14078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:43.599655 14078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:43.599677 14078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:43.600772 14078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:43.600842 14078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:43.600869 14078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:43.602595 14078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:44613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:43.602823 14078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:43.603076 14078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:43.608098 14087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:43.608117 14085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:43.608101 14084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:43.608357 14078 server_base.cc:1034] running on GCE node
I20260811 10:02:43.608623 14078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:43.608935 14078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:43.610083 14078 hybrid_clock.cc:648] HybridClock initialized: now 1786442563610071 us; error 29 us; skew 500 ppm
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:43.612524 14078 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:43.613008 14078 webserver.cc:460] Webserver started at http://127.9.127.194:43591/ using document root <none> and password file <none>
I20260811 10:02:43.613234 14078 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:43.613277 14078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:43.613444 14078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:43.614494 14078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "e45f2ffedc18444986b34dc1d0ad1e51"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "91a694bdd0bb7c8f6a9911d08ed80fa2"
server_key_iv: "8f72dcfa858962ed44c50fe291e032f0"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.614854 14078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "e45f2ffedc18444986b34dc1d0ad1e51"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "91a694bdd0bb7c8f6a9911d08ed80fa2"
server_key_iv: "8f72dcfa858962ed44c50fe291e032f0"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.616123 14078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:02:43.616888 14096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.617065 14078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 10:02:43.617175 14078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "e45f2ffedc18444986b34dc1d0ad1e51"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "91a694bdd0bb7c8f6a9911d08ed80fa2"
server_key_iv: "8f72dcfa858962ed44c50fe291e032f0"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.617256 14078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:43.626865 14078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:43.628605 14078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:43.628756 14078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:43.629040 14078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:43.629278 14078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:43.629308 14078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.629328 14078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:43.629340 14078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.635191 14078 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:43379
I20260811 10:02:43.635246 14222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:43379 every 8 connection(s)
I20260811 10:02:43.635522 14078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:43.644285 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.636292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:50669 (local address 127.9.127.254:44613)
0811 10:02:43.636338 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:43.636341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:43.636524 (+ 183us) server_negotiation.cc:407] Connection header received
0811 10:02:43.637517 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:43.637518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:43.637529 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:43.637588 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:43.638186 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.638660 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.639578 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.639751 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.639800 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.641785 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:43.641786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:43.641786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:43.641793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:43.643193 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.643537 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.643538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.643538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.643589 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.643789 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.643790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.643790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.643884 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:43.643932 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:43.644160 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 10:02:43.644224 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:02:43.644447 14225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.636248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:44613 (local address 127.9.127.194:50669)
0811 10:02:43.636406 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:43.636447 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:43.637420 (+ 973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:43.637661 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:43.637664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:43.637900 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:43.638114 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:43.638117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.638738 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.638739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:43.639504 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:43.639506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.639820 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.639821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:43.639932 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.640343 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:43.640350 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:43.641695 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:43.643265 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:43.643271 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:43.643273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:43.643474 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:43.643645 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:43.643645 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:43.643645 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:43.643737 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:43.643950 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:43.643955 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:43.644054 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 10:02:43.644131 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 10:02:43.644237 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260811 10:02:43.644562 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 14078
I20260811 10:02:43.644649 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:43.644850 9727 external_mini_cluster.cc:1428] Setting key bb8cbe97fa9156a540b33bfaa4f22588
I20260811 10:02:43.645401 14223 heartbeater.cc:347] Connected to a master server at 127.9.127.254:44613
I20260811 10:02:43.645498 14223 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:43.645687 14223 heartbeater.cc:511] Master 127.9.127.254:44613 requested a full tablet report, sending...
I20260811 10:02:43.646093 13855 ts_manager.cc:194] Registered new tserver with Master: e45f2ffedc18444986b34dc1d0ad1e51 (127.9.127.194:43379)
I20260811 10:02:43.646477 13855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:50669
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:43.671348 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:44613
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:43.751677 14229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:43.751879 14229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:43.751901 14229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:43.752957 14229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:43.752993 14229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:43.753017 14229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:43.754473 14229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:44613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:43.754653 14229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:43.754835 14229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:43.759719 14240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:43.759725 14237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:43.759732 14236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:43.760052 14229 server_base.cc:1034] running on GCE node
I20260811 10:02:43.760252 14229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:43.760485 14229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:43.761631 14229 hybrid_clock.cc:648] HybridClock initialized: now 1786442563761617 us; error 30 us; skew 500 ppm
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:43.764282 14229 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:43.764827 14229 webserver.cc:460] Webserver started at http://127.9.127.195:38953/ using document root <none> and password file <none>
I20260811 10:02:43.765086 14229 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:43.765159 14229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:43.765316 14229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:43.766361 14229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "a6d32316cd7345608826bc99579ce13d"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "b4bd68bc667d5bf3297ded21ddc09402"
server_key_iv: "5a98bcff6749a362735f03427b7dc88b"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.766810 14229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "a6d32316cd7345608826bc99579ce13d"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "b4bd68bc667d5bf3297ded21ddc09402"
server_key_iv: "5a98bcff6749a362735f03427b7dc88b"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.768164 14229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:43.768911 14247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.769155 14229 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:43.769265 14229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "a6d32316cd7345608826bc99579ce13d"
format_stamp: "Formatted at 2026-08-11 10:02:43 on dist-test-slave-1x4g"
server_key: "b4bd68bc667d5bf3297ded21ddc09402"
server_key_iv: "5a98bcff6749a362735f03427b7dc88b"
server_key_version: "encryptionkey@0"
I20260811 10:02:43.769322 14229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:43.782866 14229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:43.784636 14229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:43.784749 14229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:43.785015 14229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:43.785347 14229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:43.785414 14229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.785465 14229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:43.785499 14229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:43.792301 14229 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:37341
I20260811 10:02:43.792356 14374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:37341 every 8 connection(s)
I20260811 10:02:43.792665 14229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:43.795958 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 14229
I20260811 10:02:43.796072 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:43.796288 9727 external_mini_cluster.cc:1428] Setting key 9e9742964c5771d90357c70bf7eabe28
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:43.802345 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.793371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:59805 (local address 127.9.127.254:44613)
0811 10:02:43.793441 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:43.793443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:43.793615 (+ 172us) server_negotiation.cc:407] Connection header received
0811 10:02:43.794445 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:43.794446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:43.794456 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:43.794519 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:43.795096 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.795590 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.797119 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.797458 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.797521 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.799796 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:43.799798 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:43.799798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:43.799817 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:43.801153 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.801540 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.801541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.801541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.801592 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.801815 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.801815 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.801816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.801940 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:43.801986 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:43.802224 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 10:02:43.802283 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:02:43.802585 14379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.793299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:44613 (local address 127.9.127.195:59805)
0811 10:02:43.793476 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:43.793526 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:43.794356 (+ 830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:43.794569 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:43.794572 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:43.794799 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:43.794989 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:43.794993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.795696 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.795697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:43.797033 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:43.797036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.797542 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.797543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:43.797653 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.798095 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:43.798103 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:43.799687 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:43.801228 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:43.801235 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:43.801237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:43.801470 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:43.801651 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:43.801652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:43.801652 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:43.801756 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:43.801993 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:43.801998 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:43.802119 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 10:02:43.802211 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 10:02:43.802323 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":86,"threads_started":1}
I20260811 10:02:43.803110 14375 heartbeater.cc:347] Connected to a master server at 127.9.127.254:44613
I20260811 10:02:43.803216 14375 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:43.803346 14375 heartbeater.cc:511] Master 127.9.127.254:44613 requested a full tablet report, sending...
I20260811 10:02:43.803700 13855 ts_manager.cc:194] Registered new tserver with Master: a6d32316cd7345608826bc99579ce13d (127.9.127.195:37341)
I20260811 10:02:43.804015 13855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:59805
I20260811 10:02:43.808157 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:43.832345 14384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.825066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42826 (local address 127.9.127.193:43259)
0811 10:02:43.825250 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:43.825255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:43.825267 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:02:43.825303 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:43.825305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:43.825319 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:43.825389 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:43.825903 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.826582 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.827292 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.827602 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.827662 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.829879 (+ 2217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:43.829888 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:43.829888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:43.829894 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:43.831361 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.831689 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.831692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.831692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.831750 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.831925 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.831926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.831926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.832048 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:43.832151 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:43.832209 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 10:02:43.832269 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[13808](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:43.839876 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:43.833624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48320 (local address 127.9.127.254:44613)
0811 10:02:43.833690 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:43.833691 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:43.833700 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:43.833760 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:43.833761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:43.833769 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:43.833812 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:43.834222 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.834669 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.835272 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:43.835457 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:43.835505 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:43.837563 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:43.837564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:43.837564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:43.837570 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:43.838713 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.839116 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.839117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.839118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.839176 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:43.839367 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:43.839368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:43.839368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:43.839519 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:43.839618 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:43.839716 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 10:02:43.839786 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 10:02:43.840093 13855 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48320
I20260811 10:02:43.840461 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 13922
I20260811 10:02:43.848217 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 14078
I20260811 10:02:43.855836 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 14229
I20260811 10:02:43.862344 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 13821
2026-08-11T10:02:43Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1881 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[14390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[14390](info): set up 2 sockets
Aug 11 10:02:43 dist-test-slave-1x4g krb5kdc[14390](info): commencing operation
krb5kdc: starting...
W20260811 10:02:44.926232 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:45.047632 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41383
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:41383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:45.127202 14405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:45.127391 14405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:45.127414 14405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:45.128479 14405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:45.128511 14405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:45.128525 14405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:45.128537 14405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:45.128549 14405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:45.129995 14405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:41383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:45.130184 14405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:45.130344 14405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:45.134971 14415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:45.134971 14413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:45.134986 14412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:45.135280 14405 server_base.cc:1034] running on GCE node
I20260811 10:02:45.135548 14405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:45.135842 14405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:45.137002 14405 hybrid_clock.cc:648] HybridClock initialized: now 1786442565136996 us; error 35 us; skew 500 ppm
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:45.144212 14405 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:45.144554 14405 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:45.144630 14405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:45.144819 14405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:45.145855 14405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "d6e7754308364d40b43106a0f086bc07"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "f708f4ca18aed03cd012f4501a5efe9b"
server_key_iv: "fc5489d2f582f0d5969940fe62d8756e"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.146229 14405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "d6e7754308364d40b43106a0f086bc07"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "f708f4ca18aed03cd012f4501a5efe9b"
server_key_iv: "fc5489d2f582f0d5969940fe62d8756e"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.147537 14405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:02:45.148218 14423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.148387 14405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:45.148494 14405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "d6e7754308364d40b43106a0f086bc07"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "f708f4ca18aed03cd012f4501a5efe9b"
server_key_iv: "fc5489d2f582f0d5969940fe62d8756e"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.148566 14405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:45.159735 14405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:45.161615 14405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:45.161773 14405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:45.165854 14405 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:41383
I20260811 10:02:45.165881 14477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:41383 every 8 connection(s)
I20260811 10:02:45.166170 14405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:45.167292 14478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:45.169644 14478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07: Bootstrap starting.
I20260811 10:02:45.170230 14478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:45.170559 14478 log.cc:824] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:45.171244 14478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07: No bootstrap required, opened a new log
I20260811 10:02:45.172292 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 14405
I20260811 10:02:45.172381 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:45.172571 9727 external_mini_cluster.cc:1428] Setting key dd22dee03284fa16fa38de7a3074d4b1
I20260811 10:02:45.173167 14478 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7754308364d40b43106a0f086bc07" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41383 } }
I20260811 10:02:45.173350 14478 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:45.173389 14478 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e7754308364d40b43106a0f086bc07, State: Initialized, Role: FOLLOWER
I20260811 10:02:45.173518 14478 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7754308364d40b43106a0f086bc07" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41383 } }
I20260811 10:02:45.173609 14478 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:45.173643 14478 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:45.173695 14478 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:45.174430 14478 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7754308364d40b43106a0f086bc07" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41383 } }
I20260811 10:02:45.174525 14478 leader_election.cc:302] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6e7754308364d40b43106a0f086bc07; no voters:
I20260811 10:02:45.174688 14478 leader_election.cc:288] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:45.174716 14484 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:45.174891 14484 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [term 1 LEADER]: Becoming Leader. State: Replica: d6e7754308364d40b43106a0f086bc07, State: Running, Role: LEADER
I20260811 10:02:45.175020 14478 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:45.175036 14484 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7754308364d40b43106a0f086bc07" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41383 } }
I20260811 10:02:45.175498 14485 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e7754308364d40b43106a0f086bc07. Latest consensus state: current_term: 1 leader_uuid: "d6e7754308364d40b43106a0f086bc07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7754308364d40b43106a0f086bc07" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41383 } } }
I20260811 10:02:45.175592 14485 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:45.176029 14486 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6e7754308364d40b43106a0f086bc07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e7754308364d40b43106a0f086bc07" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41383 } } }
I20260811 10:02:45.176123 14486 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:45.176297 14494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:45.176929 14494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:45.179523 14494 catalog_manager.cc:1347] Generated new cluster ID: 5c9ecb761558479589ae7df2395eba7f
I20260811 10:02:45.179618 14494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:45.183787 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.173167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59290 (local address 127.9.127.254:41383)
0811 10:02:45.173377 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.173386 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.173420 (+ 34us) server_negotiation.cc:407] Connection header received
0811 10:02:45.173846 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.173855 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.173915 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.174071 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:45.174783 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.176208 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.177301 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.177806 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.177942 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.180410 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:45.180414 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:45.180414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:45.180433 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:45.182069 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.182456 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.182459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.182459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.182566 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.182783 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.182784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.182784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.183013 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:45.183214 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.183297 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.183434 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":98,"threads_started":1}
I20260811 10:02:45.192567 14494 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:45.193272 14494 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:45.201211 14494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07: Generated new TSK 0
I20260811 10:02:45.201373 14494 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:45.235929 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41383
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:45.319146 14507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:45.319361 14507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:45.319398 14507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:45.320513 14507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:45.320574 14507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:45.320618 14507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:45.322242 14507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:45.322499 14507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:45.322710 14507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:45.327303 14516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:45.327306 14514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:45.327338 14513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:45.327658 14507 server_base.cc:1034] running on GCE node
I20260811 10:02:45.327878 14507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:45.328132 14507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:45.329288 14507 hybrid_clock.cc:648] HybridClock initialized: now 1786442565329282 us; error 35 us; skew 500 ppm
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:45.331682 14507 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:45.332034 14507 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:45.332106 14507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:45.332255 14507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:45.333310 14507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "9405867cfaf7491b9fa107c5b4dcd356"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "77731231fb04c8c9021f5aeb406473ac"
server_key_iv: "66c2afc99ae2620e92a2f6ca8a8fbf9f"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.333706 14507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "9405867cfaf7491b9fa107c5b4dcd356"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "77731231fb04c8c9021f5aeb406473ac"
server_key_iv: "66c2afc99ae2620e92a2f6ca8a8fbf9f"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.335035 14507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:02:45.335721 14525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.335901 14507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:45.335999 14507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "9405867cfaf7491b9fa107c5b4dcd356"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "77731231fb04c8c9021f5aeb406473ac"
server_key_iv: "66c2afc99ae2620e92a2f6ca8a8fbf9f"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.336078 14507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:45.349349 14507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:45.351429 14507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:45.351541 14507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:45.351749 14507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:45.352118 14507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:45.352162 14507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.352183 14507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:45.352195 14507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.358143 14507 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:46813
I20260811 10:02:45.358210 14667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:46813 every 8 connection(s)
I20260811 10:02:45.358472 14507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:45.361682 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 14507
I20260811 10:02:45.361799 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:45.361990 9727 external_mini_cluster.cc:1428] Setting key 5d59381bd12ee2e3283570c16a4e5986
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:45.367924 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.359118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:59705 (local address 127.9.127.254:41383)
0811 10:02:45.359184 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.359186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.359404 (+ 218us) server_negotiation.cc:407] Connection header received
0811 10:02:45.359886 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.359887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.359898 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.359945 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:45.360939 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.361450 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.362821 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.363037 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.363119 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.365165 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:45.365166 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:45.365166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:45.365176 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:45.366531 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.366957 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.366958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.366958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.367016 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.367279 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.367280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.367281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.367393 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:45.367467 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.367732 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.367837 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 10:02:45.368094 14671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.359110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:41383 (local address 127.9.127.193:59705)
0811 10:02:45.359274 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.359309 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:45.359783 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:45.360025 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:45.360028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:45.360249 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:45.360839 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.360852 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.361565 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.361566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.362746 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.362749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.363145 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.363146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.363268 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.363726 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:45.363734 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:45.365069 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:45.366644 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:45.366652 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:45.366654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:45.366861 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:45.367080 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:45.367081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:45.367081 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:45.367186 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:45.367466 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:45.367475 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:45.367605 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 10:02:45.367708 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 10:02:45.367875 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260811 10:02:45.368580 14668 heartbeater.cc:347] Connected to a master server at 127.9.127.254:41383
I20260811 10:02:45.368700 14668 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:45.368889 14668 heartbeater.cc:511] Master 127.9.127.254:41383 requested a full tablet report, sending...
I20260811 10:02:45.369434 14441 ts_manager.cc:194] Registered new tserver with Master: 9405867cfaf7491b9fa107c5b4dcd356 (127.9.127.193:46813)
I20260811 10:02:45.370019 14441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:59705
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:45.389135 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41383
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:45.469410 14674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:45.469636 14674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:45.469674 14674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:45.470837 14674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:45.470907 14674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:45.470953 14674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:45.472476 14674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:45.472736 14674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:45.472975 14674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:45.477948 14684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:45.477983 14682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:45.478144 14674 server_base.cc:1034] running on GCE node
W20260811 10:02:45.477993 14680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:45.478470 14674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:45.478729 14674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:45.479895 14674 hybrid_clock.cc:648] HybridClock initialized: now 1786442565479892 us; error 36 us; skew 500 ppm
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:45.482472 14674 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:45.482792 14674 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:45.482859 14674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:45.483013 14674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:45.484099 14674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "6e2f55913537449782d990f1dbaba843"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "c458144029fea1f1a36c0fb0a635d268"
server_key_iv: "6b61fa6b551f79350d0874bcc5d365e2"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.484483 14674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "6e2f55913537449782d990f1dbaba843"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "c458144029fea1f1a36c0fb0a635d268"
server_key_iv: "6b61fa6b551f79350d0874bcc5d365e2"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.485805 14674 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:45.486585 14692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.486775 14674 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:45.486873 14674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "6e2f55913537449782d990f1dbaba843"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "c458144029fea1f1a36c0fb0a635d268"
server_key_iv: "6b61fa6b551f79350d0874bcc5d365e2"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.486972 14674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:45.501812 14674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:45.504110 14674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:45.504266 14674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:45.504508 14674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:45.504870 14674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:45.504930 14674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.504969 14674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:45.505016 14674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.510985 14674 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:44369
I20260811 10:02:45.511018 14830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:44369 every 8 connection(s)
I20260811 10:02:45.511281 14674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:45.514312 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 14674
I20260811 10:02:45.514454 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:45.514653 9727 external_mini_cluster.cc:1428] Setting key ee723e6a03d48bdb8946259a8c1ff842
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:45.521555 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.512000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:34741 (local address 127.9.127.254:41383)
0811 10:02:45.512065 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.512067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.512279 (+ 212us) server_negotiation.cc:407] Connection header received
0811 10:02:45.512761 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.512762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.512808 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.512877 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:45.513778 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.514255 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.515467 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.515653 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.515708 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.518304 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:45.518305 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:45.518305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:45.518313 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:45.519922 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.520375 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.520376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.520376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.520522 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.520821 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.520822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.520822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.521005 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:45.521070 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.521421 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.521491 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:02:45.521874 14833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.511966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:41383 (local address 127.9.127.194:34741)
0811 10:02:45.512151 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.512192 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:45.512679 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:45.512960 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:45.512963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:45.513227 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:45.513701 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.513706 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.514351 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.514352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.515378 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.515382 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.515739 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.515741 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.515893 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.516344 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:45.516354 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:45.518207 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:45.520005 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:45.520012 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:45.520013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:45.520295 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:45.520602 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:45.520602 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:45.520603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:45.520702 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:45.521083 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:45.521091 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:45.521268 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 10:02:45.521399 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 10:02:45.521598 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
I20260811 10:02:45.522465 14831 heartbeater.cc:347] Connected to a master server at 127.9.127.254:41383
I20260811 10:02:45.522583 14831 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:45.522742 14831 heartbeater.cc:511] Master 127.9.127.254:41383 requested a full tablet report, sending...
I20260811 10:02:45.523156 14441 ts_manager.cc:194] Registered new tserver with Master: 6e2f55913537449782d990f1dbaba843 (127.9.127.194:44369)
I20260811 10:02:45.523551 14441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:34741
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:45.542891 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41383
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:45.621099 14836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:45.621282 14836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:45.621305 14836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:45.622437 14836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:45.622478 14836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:45.622502 14836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:45.623946 14836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:45.624179 14836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:45.624404 14836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:45.629168 14842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:45.629175 14844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:45.629175 14841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:45.629464 14836 server_base.cc:1034] running on GCE node
I20260811 10:02:45.629739 14836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:45.629998 14836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:45.631141 14836 hybrid_clock.cc:648] HybridClock initialized: now 1786442565631130 us; error 28 us; skew 500 ppm
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:45.633495 14836 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:45.633805 14836 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:45.633869 14836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:45.634033 14836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:45.634964 14836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "812f63617634476cad82c9f7fb6a25dc"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "ff2cd3862318b90303b20e2f332a14f9"
server_key_iv: "cb11a74552740dd289c51884038a0c8f"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.635299 14836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "812f63617634476cad82c9f7fb6a25dc"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "ff2cd3862318b90303b20e2f332a14f9"
server_key_iv: "cb11a74552740dd289c51884038a0c8f"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.636494 14836 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:45.637272 14851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.637441 14836 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.637540 14836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "812f63617634476cad82c9f7fb6a25dc"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "ff2cd3862318b90303b20e2f332a14f9"
server_key_iv: "cb11a74552740dd289c51884038a0c8f"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.637609 14836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:45.648205 14836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:45.649870 14836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:45.650030 14836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:45.650231 14836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:45.650558 14836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:45.650617 14836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.650655 14836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:45.650714 14836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.656253 14836 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:35985
I20260811 10:02:45.656286 14982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:35985 every 8 connection(s)
I20260811 10:02:45.656530 14836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:45.657437 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 14836
I20260811 10:02:45.657557 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:45.657754 9727 external_mini_cluster.cc:1428] Setting key d506f9ac093293292998240519003ed3
Aug 11 10:02:45 dist-test-slave-1x4g krb5kdc[14390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442565, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:45.665410 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.657292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:39579 (local address 127.9.127.254:41383)
0811 10:02:45.657364 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.657366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.657601 (+ 235us) server_negotiation.cc:407] Connection header received
0811 10:02:45.658161 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.658163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.658175 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.658222 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:45.659223 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.659729 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.660609 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.660853 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.660918 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.662852 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:45.662853 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:45.662853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:45.662860 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:45.664215 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.664542 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.664543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.664543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.664601 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.664877 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.664877 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.664878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.664975 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:45.665028 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.665293 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.665350 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 10:02:45.665570 14985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.657252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:41383 (local address 127.9.127.195:39579)
0811 10:02:45.657454 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.657498 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:45.658047 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:45.658297 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:45.658301 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:45.658643 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:45.659148 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.659153 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.659806 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.659806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.660534 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.660536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.660923 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.660924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.661021 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.661369 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:45.661376 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:45.662762 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:45.664282 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:45.664288 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:45.664289 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:45.664480 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:45.664655 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:45.664655 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:45.664655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:45.664742 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:45.665064 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:45.665070 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:45.665175 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 10:02:45.665266 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 10:02:45.665374 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":109,"threads_started":1}
I20260811 10:02:45.666013 14983 heartbeater.cc:347] Connected to a master server at 127.9.127.254:41383
I20260811 10:02:45.666119 14983 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:45.666260 14983 heartbeater.cc:511] Master 127.9.127.254:41383 requested a full tablet report, sending...
I20260811 10:02:45.666615 14441 ts_manager.cc:194] Registered new tserver with Master: 812f63617634476cad82c9f7fb6a25dc (127.9.127.195:35985)
I20260811 10:02:45.666960 14441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:39579
I20260811 10:02:45.669401 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:02:45.676236 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.670676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59306 (local address 127.9.127.254:41383)
0811 10:02:45.670717 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.670719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.670846 (+ 127us) server_negotiation.cc:407] Connection header received
0811 10:02:45.670894 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.670895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.670903 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.670940 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:45.671473 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.671907 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.672563 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.672729 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.672795 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.673838 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:45.673839 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:45.673840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:45.673845 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:45.675130 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.675424 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.675425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.675425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.675474 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:45.675668 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:45.675669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:45.675669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:45.675849 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:45.675925 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.676032 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.676117 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:02:45.677654 14441 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:45.679122 14441 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:45.685308 14996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.681383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:46813 (local address 127.0.0.1:40436)
0811 10:02:45.681550 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.681559 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:45.681600 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:45.682010 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:45.682010 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:45.682013 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:45.682048 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.682050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.682982 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.682983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.684244 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.684247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.685004 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.685005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.685082 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.685095 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 10:02:45.685190 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 10:02:45.685242 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":36,"thread_start_us":32,"threads_started":1}
I20260811 10:02:45.685403 14992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.681180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:44369 (local address 127.0.0.1:50668)
0811 10:02:45.681342 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.681377 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:45.681440 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:45.681892 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:45.681893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:45.681896 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:45.681964 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.681966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.683246 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.683247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.684332 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.684334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.685198 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.685199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.685250 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.685254 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:45.685282 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 10:02:45.685327 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":42,"thread_start_us":68,"threads_started":1}
I20260811 10:02:45.685483 14994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.681290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45228 (local address 127.9.127.195:35985)
0811 10:02:45.681432 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.681436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.681631 (+ 195us) server_negotiation.cc:407] Connection header received
0811 10:02:45.681675 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.681677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.681693 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.681770 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:45.682019 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.683093 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.684290 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.684988 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.685056 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.685118 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.685371 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.685405 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260811 10:02:45.685606 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.681217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:35985 (local address 127.0.0.1:45228)
0811 10:02:45.681477 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.681488 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:45.681547 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:45.681783 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:45.681786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:45.681788 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:45.681851 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.681852 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.683215 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.683216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.684211 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.684213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.685156 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.685157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.685233 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.685236 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:45.685284 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 10:02:45.685327 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":4,"thread_start_us":48,"threads_started":1}
I20260811 10:02:45.685783 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.681308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50668 (local address 127.9.127.194:44369)
0811 10:02:45.681719 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.681723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.681732 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:45.681770 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.681772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.681788 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.682046 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:45.682141 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.683147 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.684407 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.685112 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.685568 (+ 456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.685652 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.685677 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.685717 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":77,"threads_started":1}
I20260811 10:02:45.685326 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.681571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40436 (local address 127.9.127.193:46813)
0811 10:02:45.681728 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.681732 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.681742 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:02:45.681783 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.681785 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.681800 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.681881 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:45.682136 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.682878 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.684339 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.684917 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.685000 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.685055 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.685210 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.685247 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260811 10:02:45.686344 14587 tablet_service.cc:1467] Processing CreateTablet for tablet b602c8baaad744229c501d2fd18f1362 (DEFAULT_TABLE table=test-table [id=e628c4d9393b4c81b77f030f754f585b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:45.686439 14905 tablet_service.cc:1467] Processing CreateTablet for tablet b602c8baaad744229c501d2fd18f1362 (DEFAULT_TABLE table=test-table [id=e628c4d9393b4c81b77f030f754f585b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:45.686606 14587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b602c8baaad744229c501d2fd18f1362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:45.686792 14905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b602c8baaad744229c501d2fd18f1362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:45.688887 14998 tablet_bootstrap.cc:492] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356: Bootstrap starting.
I20260811 10:02:45.689288 14753 tablet_service.cc:1467] Processing CreateTablet for tablet b602c8baaad744229c501d2fd18f1362 (DEFAULT_TABLE table=test-table [id=e628c4d9393b4c81b77f030f754f585b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:45.689566 14998 tablet_bootstrap.cc:654] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:45.689616 14753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b602c8baaad744229c501d2fd18f1362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:45.690271 14998 log.cc:824] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:45.691092 14998 tablet_bootstrap.cc:492] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356: No bootstrap required, opened a new log
I20260811 10:02:45.691170 14998 ts_tablet_manager.cc:1397] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 10:02:45.693151 15001 tablet_bootstrap.cc:492] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Bootstrap starting.
I20260811 10:02:45.693226 14999 tablet_bootstrap.cc:492] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: Bootstrap starting.
I20260811 10:02:45.693257 14998 raft_consensus.cc:348] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.693431 14998 raft_consensus.cc:374] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:45.693473 14998 raft_consensus.cc:729] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9405867cfaf7491b9fa107c5b4dcd356, State: Initialized, Role: FOLLOWER
I20260811 10:02:45.693599 14998 consensus_queue.cc:260] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.693828 14999 tablet_bootstrap.cc:654] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:45.693828 15001 tablet_bootstrap.cc:654] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:45.693884 14998 ts_tablet_manager.cc:1428] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 10:02:45.693940 14668 heartbeater.cc:503] Master 127.9.127.254:41383 was elected leader, sending a full tablet report...
I20260811 10:02:45.694450 15001 log.cc:824] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:45.694450 14999 log.cc:824] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:45.695227 14999 tablet_bootstrap.cc:492] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: No bootstrap required, opened a new log
I20260811 10:02:45.695300 14999 ts_tablet_manager.cc:1397] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:45.695401 15001 tablet_bootstrap.cc:492] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: No bootstrap required, opened a new log
I20260811 10:02:45.695461 15001 ts_tablet_manager.cc:1397] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:45.697288 14999 raft_consensus.cc:348] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.697453 14999 raft_consensus.cc:374] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:45.697489 14999 raft_consensus.cc:729] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812f63617634476cad82c9f7fb6a25dc, State: Initialized, Role: FOLLOWER
I20260811 10:02:45.697429 15001 raft_consensus.cc:348] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.697583 15001 raft_consensus.cc:374] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:45.697629 15001 raft_consensus.cc:729] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e2f55913537449782d990f1dbaba843, State: Initialized, Role: FOLLOWER
I20260811 10:02:45.697605 14999 consensus_queue.cc:260] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.697738 15001 consensus_queue.cc:260] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.697889 14983 heartbeater.cc:503] Master 127.9.127.254:41383 was elected leader, sending a full tablet report...
I20260811 10:02:45.698040 14831 heartbeater.cc:503] Master 127.9.127.254:41383 was elected leader, sending a full tablet report...
I20260811 10:02:45.698140 14999 ts_tablet_manager.cc:1428] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:02:45.698025 15001 ts_tablet_manager.cc:1428] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260811 10:02:45.761811 14832 tablet.cc:2369] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:45.781085 15006 raft_consensus.cc:482] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:45.781226 15006 raft_consensus.cc:504] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.781575 15006 leader_election.cc:288] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 812f63617634476cad82c9f7fb6a25dc (127.9.127.195:35985), 9405867cfaf7491b9fa107c5b4dcd356 (127.9.127.193:46813)
I20260811 10:02:45.784431 14994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.781842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:50729 (local address 127.9.127.195:35985)
0811 10:02:45.781912 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.781914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.781925 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:02:45.781958 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.781959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.781970 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.782049 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:45.782185 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.782717 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.783689 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.784090 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.784168 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.784177 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.784332 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.784366 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 10:02:45.784432 14833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.781746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:35985 (local address 127.9.127.194:50729)
0811 10:02:45.781810 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.781824 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:45.781898 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:45.782055 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:45.782056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:45.782058 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:45.782109 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.782110 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.782829 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.782830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.783600 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.783602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.784168 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.784169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.784241 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.784244 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:45.784326 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 10:02:45.784365 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 10:02:45.784577 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.781948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:55447 (local address 127.9.127.193:46813)
0811 10:02:45.782038 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.782039 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.782145 (+ 106us) server_negotiation.cc:407] Connection header received
0811 10:02:45.782210 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.782211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.782219 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.782291 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:45.782467 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.782941 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.783852 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.784190 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.784287 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.784295 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.784448 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.784491 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 10:02:45.784757 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.781864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:46813 (local address 127.9.127.194:55447)
0811 10:02:45.782077 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.782085 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:45.782150 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:45.782297 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:45.782298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:45.782299 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:45.782365 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.782367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.783027 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.783028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.783763 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:45.783764 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.784291 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.784292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:45.784374 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.784377 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:45.784440 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 10:02:45.784617 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":128,"threads_started":1}
I20260811 10:02:45.784770 14928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b602c8baaad744229c501d2fd18f1362" candidate_uuid: "6e2f55913537449782d990f1dbaba843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812f63617634476cad82c9f7fb6a25dc" is_pre_election: true
I20260811 10:02:45.784955 14928 raft_consensus.cc:2454] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e2f55913537449782d990f1dbaba843 in term 0.
I20260811 10:02:45.785120 14611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b602c8baaad744229c501d2fd18f1362" candidate_uuid: "6e2f55913537449782d990f1dbaba843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9405867cfaf7491b9fa107c5b4dcd356" is_pre_election: true
I20260811 10:02:45.785176 14695 leader_election.cc:302] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e2f55913537449782d990f1dbaba843, 812f63617634476cad82c9f7fb6a25dc; no voters:
I20260811 10:02:45.785251 14611 raft_consensus.cc:2454] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e2f55913537449782d990f1dbaba843 in term 0.
I20260811 10:02:45.785331 15006 raft_consensus.cc:2781] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:45.785385 15006 raft_consensus.cc:482] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:45.785429 15006 raft_consensus.cc:3037] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:45.786092 15006 raft_consensus.cc:504] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.786221 15006 leader_election.cc:288] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [CANDIDATE]: Term 1 election: Requested vote from peers 812f63617634476cad82c9f7fb6a25dc (127.9.127.195:35985), 9405867cfaf7491b9fa107c5b4dcd356 (127.9.127.193:46813)
I20260811 10:02:45.786382 14928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b602c8baaad744229c501d2fd18f1362" candidate_uuid: "6e2f55913537449782d990f1dbaba843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "812f63617634476cad82c9f7fb6a25dc"
I20260811 10:02:45.786439 14611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b602c8baaad744229c501d2fd18f1362" candidate_uuid: "6e2f55913537449782d990f1dbaba843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9405867cfaf7491b9fa107c5b4dcd356"
I20260811 10:02:45.786481 14928 raft_consensus.cc:3037] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:45.786497 14611 raft_consensus.cc:3037] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:45.787206 14928 raft_consensus.cc:2454] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e2f55913537449782d990f1dbaba843 in term 1.
I20260811 10:02:45.787312 14611 raft_consensus.cc:2454] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e2f55913537449782d990f1dbaba843 in term 1.
I20260811 10:02:45.787421 14695 leader_election.cc:302] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e2f55913537449782d990f1dbaba843, 812f63617634476cad82c9f7fb6a25dc; no voters:
I20260811 10:02:45.787520 15006 raft_consensus.cc:2781] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:45.787693 15006 raft_consensus.cc:686] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 1 LEADER]: Becoming Leader. State: Replica: 6e2f55913537449782d990f1dbaba843, State: Running, Role: LEADER
I20260811 10:02:45.787801 15006 consensus_queue.cc:237] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } }
I20260811 10:02:45.788606 14440 catalog_manager.cc:5495] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e2f55913537449782d990f1dbaba843 (127.9.127.194). New cstate: current_term: 1 leader_uuid: "6e2f55913537449782d990f1dbaba843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e2f55913537449782d990f1dbaba843" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:45.798584 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.796539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50674 (local address 127.9.127.194:44369)
0811 10:02:45.796583 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.796596 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.796604 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:45.796657 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.796658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.796671 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.796745 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:45.796907 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.797315 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.797980 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:45.798145 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:45.798191 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:45.798328 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:45.798409 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:45.798465 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.798503 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.798518 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 10:02:45.800154 14928 raft_consensus.cc:1261] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 1 FOLLOWER]: Refusing update from remote peer 6e2f55913537449782d990f1dbaba843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:45.800155 14611 raft_consensus.cc:1261] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 1 FOLLOWER]: Refusing update from remote peer 6e2f55913537449782d990f1dbaba843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:45.800498 15008 consensus_queue.cc:1035] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9405867cfaf7491b9fa107c5b4dcd356" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 46813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:45.800619 15006 consensus_queue.cc:1035] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "812f63617634476cad82c9f7fb6a25dc" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 35985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:45.803097 15014 mvcc.cc:205] Tried to move back new op lower bound from 7317268749514956800 to 7317268749467463680. Current Snapshot: MvccSnapshot[applied={T|T < 7317268749514956800}]
I20260811 10:02:45.803897 15015 mvcc.cc:205] Tried to move back new op lower bound from 7317268749514956800 to 7317268749467463680. Current Snapshot: MvccSnapshot[applied={T|T < 7317268749514956800 or (T in {7317268749514956800})}]
I20260811 10:02:45.805083 14440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:45.805173 14440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:45.805840 14440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d6e7754308364d40b43106a0f086bc07: Sending DeleteTablet for 3 replicas of tablet b602c8baaad744229c501d2fd18f1362
I20260811 10:02:45.806123 14753 tablet_service.cc:1514] Processing DeleteTablet for tablet b602c8baaad744229c501d2fd18f1362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:45 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:50668
I20260811 10:02:45.806208 14905 tablet_service.cc:1514] Processing DeleteTablet for tablet b602c8baaad744229c501d2fd18f1362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:45 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:45228
I20260811 10:02:45.806238 14587 tablet_service.cc:1514] Processing DeleteTablet for tablet b602c8baaad744229c501d2fd18f1362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:45 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:40436
I20260811 10:02:45.806414 15024 tablet_replica.cc:330] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: stopping tablet replica
I20260811 10:02:45.806442 15025 tablet_replica.cc:330] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356: stopping tablet replica
I20260811 10:02:45.806533 15025 raft_consensus.cc:2229] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:45.806548 15024 raft_consensus.cc:2229] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:45.806630 15025 raft_consensus.cc:2258] T b602c8baaad744229c501d2fd18f1362 P 9405867cfaf7491b9fa107c5b4dcd356 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:45.806707 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 14507
I20260811 10:02:45.809119 15024 raft_consensus.cc:2258] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:45.809530 15024 ts_tablet_manager.cc:1905] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:45.810989 15024 ts_tablet_manager.cc:1918] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:45.811079 15024 log.cc:1196] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/b602c8baaad744229c501d2fd18f1362
I20260811 10:02:45.811355 15024 ts_tablet_manager.cc:1939] T b602c8baaad744229c501d2fd18f1362 P 812f63617634476cad82c9f7fb6a25dc: Deleting consensus metadata
I20260811 10:02:45.811769 14426 catalog_manager.cc:4841] TS 812f63617634476cad82c9f7fb6a25dc (127.9.127.195:35985): tablet b602c8baaad744229c501d2fd18f1362 (table test-table [id=e628c4d9393b4c81b77f030f754f585b]) successfully deleted
I20260811 10:02:45.812896 15023 tablet_replica.cc:330] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: stopping tablet replica
I20260811 10:02:45.813011 15023 raft_consensus.cc:2229] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:45.813110 15023 raft_consensus.cc:2258] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:45.813905 15023 ts_tablet_manager.cc:1905] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:45.815251 15023 ts_tablet_manager.cc:1918] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:45.815330 15023 log.cc:1196] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/b602c8baaad744229c501d2fd18f1362
I20260811 10:02:45.815560 15023 ts_tablet_manager.cc:1939] T b602c8baaad744229c501d2fd18f1362 P 6e2f55913537449782d990f1dbaba843: Deleting consensus metadata
W20260811 10:02:45.815730 14426 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:46813 (error 108)
I20260811 10:02:45.816004 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 14674
I20260811 10:02:45.816013 14427 catalog_manager.cc:4841] TS 6e2f55913537449782d990f1dbaba843 (127.9.127.194:44369): tablet b602c8baaad744229c501d2fd18f1362 (table test-table [id=e628c4d9393b4c81b77f030f754f585b]) successfully deleted
I20260811 10:02:45.822288 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.822161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:46813 (local address 127.0.0.1:40452)
0811 10:02:45.822223 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:45.822263 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:46813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 10:02:45.822417 14426 catalog_manager.cc:4584] TS 9405867cfaf7491b9fa107c5b4dcd356 (127.9.127.193:46813): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b602c8baaad744229c501d2fd18f1362: Network error: Client connection negotiation failed: client connection to 127.9.127.193:46813: connect: Connection refused (error 111)
I20260811 10:02:45.825575 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 14836
I20260811 10:02:45.833092 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 14405
2026-08-11T10:02:45Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1971 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T10:02:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:45Z Disabled control of system clock
I20260811 10:02:45.861927 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:45567
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:37235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:45567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 10:02:45.939453 15035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:45.939656 15035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:45.939675 15035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:45.940737 15035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:45.940795 15035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:45.940810 15035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:45.940824 15035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:45.940836 15035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:45.942097 15035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:45567
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:45567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:45.942278 15035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:45.942513 15035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:45.947093 15041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:45.947108 15040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:45.947219 15035 server_base.cc:1034] running on GCE node
W20260811 10:02:45.947098 15043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:45.947508 15035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:45.947777 15035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:45.948905 15035 hybrid_clock.cc:648] HybridClock initialized: now 1786442565948880 us; error 43 us; skew 500 ppm
I20260811 10:02:45.950088 15035 webserver.cc:460] Webserver started at http://127.9.127.254:38851/ using document root <none> and password file <none>
I20260811 10:02:45.950384 15035 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:45.950428 15035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:45.950579 15035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:45.951593 15035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "4defce75e1d84dada9a51dddfa96a8e1"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "dd5c9d837a889994c32aa26d50878653"
server_key_iv: "5a85c1780f08fe7dee7a426086be3c57"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.951947 15035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "4defce75e1d84dada9a51dddfa96a8e1"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "dd5c9d837a889994c32aa26d50878653"
server_key_iv: "5a85c1780f08fe7dee7a426086be3c57"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.953284 15035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:45.953986 15050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:45.954166 15035 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:45.954270 15035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "4defce75e1d84dada9a51dddfa96a8e1"
format_stamp: "Formatted at 2026-08-11 10:02:45 on dist-test-slave-1x4g"
server_key: "dd5c9d837a889994c32aa26d50878653"
server_key_iv: "5a85c1780f08fe7dee7a426086be3c57"
server_key_version: "encryptionkey@0"
I20260811 10:02:45.954358 15035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:45.957616 15035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:45.957866 15035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:45.958022 15035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:45.961817 15035 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:45567
I20260811 10:02:45.961844 15111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:45567 every 8 connection(s)
I20260811 10:02:45.962234 15035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:45.963451 15112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:45.965991 15112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1: Bootstrap starting.
I20260811 10:02:45.966343 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 15035
I20260811 10:02:45.966452 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:45.966622 9727 external_mini_cluster.cc:1428] Setting key f776b7a950a2b3bee90088477aadac79
I20260811 10:02:45.966701 15112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:45.967067 15112 log.cc:824] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:45.968659 15112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1: No bootstrap required, opened a new log
I20260811 10:02:45.968886 15115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:45.967095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32948 (local address 127.9.127.254:45567)
0811 10:02:45.967316 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:45.967324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:45.967357 (+ 33us) server_negotiation.cc:407] Connection header received
0811 10:02:45.967719 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:45.967725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:45.967759 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:45.967867 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:45.968452 (+ 585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:45.968456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:45.968456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:45.968460 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:45.968506 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:45.968519 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:45.968603 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:45.968634 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 10:02:45.968682 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260811 10:02:45.970219 15112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4defce75e1d84dada9a51dddfa96a8e1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45567 } }
I20260811 10:02:45.970337 15112 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:45.970358 15112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4defce75e1d84dada9a51dddfa96a8e1, State: Initialized, Role: FOLLOWER
I20260811 10:02:45.970464 15112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4defce75e1d84dada9a51dddfa96a8e1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45567 } }
I20260811 10:02:45.970546 15112 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:45.970568 15112 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:45.970606 15112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:45.971328 15112 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4defce75e1d84dada9a51dddfa96a8e1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45567 } }
I20260811 10:02:45.971414 15112 leader_election.cc:302] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4defce75e1d84dada9a51dddfa96a8e1; no voters:
I20260811 10:02:45.971529 15112 leader_election.cc:288] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:45.971593 15118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:45.971730 15118 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 4defce75e1d84dada9a51dddfa96a8e1, State: Running, Role: LEADER
I20260811 10:02:45.971820 15118 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4defce75e1d84dada9a51dddfa96a8e1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45567 } }
I20260811 10:02:45.971829 15112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:45.973054 15120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4defce75e1d84dada9a51dddfa96a8e1. Latest consensus state: current_term: 1 leader_uuid: "4defce75e1d84dada9a51dddfa96a8e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4defce75e1d84dada9a51dddfa96a8e1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45567 } } }
I20260811 10:02:45.973054 15119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4defce75e1d84dada9a51dddfa96a8e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4defce75e1d84dada9a51dddfa96a8e1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45567 } } }
I20260811 10:02:45.973207 15120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:45.973227 15119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1 [sys.catalog]: This master's current role is: LEADER
W20260811 10:02:45.973728 15133 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:02:45.973786 15133 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:02:45.973850 15134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:45.974018 15134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:45.975466 15134 catalog_manager.cc:1347] Generated new cluster ID: 781772f592ce4add8c84b3860fc8d993
I20260811 10:02:45.975528 15134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:45.991011 15134 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:45.991173 15134 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:45.994740 15134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1: Generated new TSK 0
I20260811 10:02:45.994920 15134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:02:46.005089 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45567
--builtin_ntp_servers=127.9.127.212:37235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 10:02:46.085006 15137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:46.085211 15137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:46.085244 15137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:46.086361 15137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:46.086421 15137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:46.086462 15137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:46.087729 15137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:46.087960 15137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:46.088219 15137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 10:02:46.093075 15137 server_base.cc:1034] running on GCE node
W20260811 10:02:46.093052 15142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:46.093046 15143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:46.093034 15146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:46.093415 15137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:46.093674 15137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:46.094835 15137 hybrid_clock.cc:648] HybridClock initialized: now 1786442566094824 us; error 23 us; skew 500 ppm
I20260811 10:02:46.095991 15137 webserver.cc:460] Webserver started at http://127.9.127.193:37687/ using document root <none> and password file <none>
I20260811 10:02:46.096221 15137 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:46.096287 15137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:46.096419 15137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:46.097561 15137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "a70b096b6b784dacbf8e2238ed8c1f96"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "395d77ccd1e6d55663997cfd7726019d"
server_key_iv: "f81f87be2dab527bbb65bc5f9377a6c2"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.097930 15137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "a70b096b6b784dacbf8e2238ed8c1f96"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "395d77ccd1e6d55663997cfd7726019d"
server_key_iv: "f81f87be2dab527bbb65bc5f9377a6c2"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.099364 15137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:02:46.100098 15153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.100270 15137 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:46.100373 15137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "a70b096b6b784dacbf8e2238ed8c1f96"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "395d77ccd1e6d55663997cfd7726019d"
server_key_iv: "f81f87be2dab527bbb65bc5f9377a6c2"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.100464 15137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:46.103833 15137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:46.104106 15137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:46.104272 15137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:46.104496 15137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:46.104857 15137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:46.104923 15137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.104965 15137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:46.104995 15137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.111083 15137 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:33053
I20260811 10:02:46.111116 15282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:33053 every 8 connection(s)
I20260811 10:02:46.111455 15137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:46.114543 15115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.112155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:41697 (local address 127.9.127.254:45567)
0811 10:02:46.112223 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.112225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.112457 (+ 232us) server_negotiation.cc:407] Connection header received
0811 10:02:46.113024 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.113026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.113034 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.113102 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.114242 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.114244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.114244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.114249 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.114267 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.114272 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.114349 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.114453 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.114469 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:02:46.114732 15287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.112142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45567 (local address 127.9.127.193:41697)
0811 10:02:46.112336 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.112365 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.112913 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.113167 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.113171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.113187 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:46.114078 (+ 891us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:02:46.114079 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:46.114104 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:02:46.114132 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:46.114348 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:46.114356 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:46.114359 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:46.114465 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 10:02:46.114524 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260811 10:02:46.115271 15285 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45567
I20260811 10:02:46.115358 15285 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:46.115460 15285 heartbeater.cc:511] Master 127.9.127.254:45567 requested a full tablet report, sending...
I20260811 10:02:46.115944 15070 ts_manager.cc:194] Registered new tserver with Master: a70b096b6b784dacbf8e2238ed8c1f96 (127.9.127.193:33053)
I20260811 10:02:46.120756 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 15137
I20260811 10:02:46.120903 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:46.121057 9727 external_mini_cluster.cc:1428] Setting key 13775de6fbccff7c49b356d75d0c2bb7
I20260811 10:02:46.121920 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45567
--builtin_ntp_servers=127.9.127.212:37235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 10:02:46.201807 15288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:46.201992 15288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:46.202025 15288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:46.203147 15288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:46.203182 15288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:46.203218 15288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:46.204547 15288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:46.204737 15288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:46.205046 15288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:46.210407 15294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:46.210613 15288 server_base.cc:1034] running on GCE node
W20260811 10:02:46.210677 15293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:46.210772 15296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:46.211076 15288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:46.211338 15288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:46.212517 15288 hybrid_clock.cc:648] HybridClock initialized: now 1786442566212495 us; error 37 us; skew 500 ppm
I20260811 10:02:46.213963 15288 webserver.cc:460] Webserver started at http://127.9.127.194:35543/ using document root <none> and password file <none>
I20260811 10:02:46.214227 15288 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:46.214283 15288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:46.214404 15288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:46.215811 15288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "6f845722fd2fa24b47e52e04355f41e8"
server_key_iv: "86f5691f170def5f877c26472931fdd4"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.216245 15288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "6f845722fd2fa24b47e52e04355f41e8"
server_key_iv: "86f5691f170def5f877c26472931fdd4"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.217855 15288 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 10:02:46.218537 15302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.218725 15288 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:46.218794 15288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "6f845722fd2fa24b47e52e04355f41e8"
server_key_iv: "86f5691f170def5f877c26472931fdd4"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.218845 15288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:46.222036 15288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:46.222307 15288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:46.222412 15288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:46.222565 15288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:46.222795 15288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:46.222822 15288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.222841 15288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:46.222854 15288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.228847 15288 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:43105
I20260811 10:02:46.228896 15430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:43105 every 8 connection(s)
I20260811 10:02:46.229195 15288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:46.232450 15115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.230014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:45773 (local address 127.9.127.254:45567)
0811 10:02:46.230103 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.230105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.230298 (+ 193us) server_negotiation.cc:407] Connection header received
0811 10:02:46.230916 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.230918 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.230926 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.230985 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.232195 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.232196 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.232197 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.232201 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.232218 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.232222 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.232294 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.232364 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.232378 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:02:46.232663 15433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.229984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45567 (local address 127.9.127.194:45773)
0811 10:02:46.230186 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.230220 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.230797 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.231053 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.231057 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.231067 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:46.232043 (+ 976us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:02:46.232044 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:46.232072 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:02:46.232102 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:46.232294 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:46.232300 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:46.232303 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:46.232376 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 10:02:46.232436 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260811 10:02:46.233172 15431 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45567
I20260811 10:02:46.233270 15431 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:46.233418 15431 heartbeater.cc:511] Master 127.9.127.254:45567 requested a full tablet report, sending...
I20260811 10:02:46.233801 15070 ts_manager.cc:194] Registered new tserver with Master: e5d16a752d6c4068a66a01aa9c6e8b6d (127.9.127.194:43105)
I20260811 10:02:46.237428 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 15288
I20260811 10:02:46.237512 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:46.237739 9727 external_mini_cluster.cc:1428] Setting key 45ae7d08d70588616dcf042e1f756bc2
I20260811 10:02:46.238674 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45567
--builtin_ntp_servers=127.9.127.212:37235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 10:02:46.324826 15434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:46.325021 15434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:46.325042 15434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:46.326200 15434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:46.326238 15434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:46.326287 15434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:46.327610 15434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:46.327857 15434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:46.328151 15434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:46.333227 15443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:46.333221 15441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:46.333237 15440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:46.333506 15434 server_base.cc:1034] running on GCE node
I20260811 10:02:46.333734 15434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:46.333966 15434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:46.335126 15434 hybrid_clock.cc:648] HybridClock initialized: now 1786442566335104 us; error 38 us; skew 500 ppm
I20260811 10:02:46.336261 15434 webserver.cc:460] Webserver started at http://127.9.127.195:34717/ using document root <none> and password file <none>
I20260811 10:02:46.336440 15434 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:46.336478 15434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:46.336565 15434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:46.337802 15434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "df87f1d6f5054b7f8e49a6e3f7096be6"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "b3cc1390a8f27bc9eaa8901f11203214"
server_key_iv: "0fbc1a822c9e9a3f35ee38417ccde17a"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.338119 15434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "df87f1d6f5054b7f8e49a6e3f7096be6"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "b3cc1390a8f27bc9eaa8901f11203214"
server_key_iv: "0fbc1a822c9e9a3f35ee38417ccde17a"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.339313 15434 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:02:46.339994 15450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.340147 15434 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:46.340245 15434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "df87f1d6f5054b7f8e49a6e3f7096be6"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "b3cc1390a8f27bc9eaa8901f11203214"
server_key_iv: "0fbc1a822c9e9a3f35ee38417ccde17a"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.340296 15434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:46.343528 15434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:46.343760 15434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:46.343891 15434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:46.344084 15434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:46.344379 15434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:46.344449 15434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.344494 15434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:46.344515 15434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.349964 15434 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:41351
I20260811 10:02:46.350023 15581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:41351 every 8 connection(s)
I20260811 10:02:46.350324 15434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:46.353286 15115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.351037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:34281 (local address 127.9.127.254:45567)
0811 10:02:46.351128 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.351131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.351319 (+ 188us) server_negotiation.cc:407] Connection header received
0811 10:02:46.351829 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.351831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.351838 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.351891 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.353045 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.353047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.353047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.353052 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.353068 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.353072 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.353130 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.353201 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.353216 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 10:02:46.353469 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.350985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45567 (local address 127.9.127.195:34281)
0811 10:02:46.351192 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.351250 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.351723 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.351955 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.351959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.351969 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:46.352902 (+ 933us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:02:46.352903 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:46.352929 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:02:46.352956 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:46.353127 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:46.353133 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:46.353136 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:46.353211 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 10:02:46.353269 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260811 10:02:46.353971 15582 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45567
I20260811 10:02:46.354043 15582 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:46.354203 15582 heartbeater.cc:511] Master 127.9.127.254:45567 requested a full tablet report, sending...
I20260811 10:02:46.354449 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 15434
I20260811 10:02:46.354566 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:46.354604 15070 ts_manager.cc:194] Registered new tserver with Master: df87f1d6f5054b7f8e49a6e3f7096be6 (127.9.127.195:41351)
I20260811 10:02:46.354755 9727 external_mini_cluster.cc:1428] Setting key 99e639ba82d851e3c082ba353b0a183e
I20260811 10:02:46.355573 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:02:46.358191 15115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.356902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32952 (local address 127.9.127.254:45567)
0811 10:02:46.357426 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.357427 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.357435 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:46.357454 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.357454 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.357458 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.357511 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.358030 (+ 519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.358032 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.358032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.358047 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.358064 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.358067 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.358108 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.358140 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.358149 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505}
I20260811 10:02:46.359633 15070 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:46.361299 15070 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:46.365082 15590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.363352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:41351 (local address 127.0.0.1:56832)
0811 10:02:46.363461 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.363503 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.363556 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.363978 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.363984 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.363991 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:46.364517 (+ 526us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:02:46.364517 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:46.364533 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:02:46.364553 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:46.364933 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:46.364940 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:46.364943 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:46.365006 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 10:02:46.365020 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"thread_start_us":49,"threads_started":1}
I20260811 10:02:46.365098 15594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.363633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56832 (local address 127.9.127.195:41351)
0811 10:02:46.363794 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.363798 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.363808 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:02:46.363831 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.363834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.363843 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.363952 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.364632 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.364640 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.364641 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.364645 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.364677 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.364698 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.364936 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.365013 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.365027 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":68,"threads_started":1}
I20260811 10:02:46.365200 15593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.363364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:33053 (local address 127.0.0.1:39852)
0811 10:02:46.363784 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.363793 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.363841 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.364281 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.364281 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.364284 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:46.364806 (+ 522us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:02:46.364807 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:46.364813 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:02:46.364827 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:46.365057 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:46.365058 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:46.365059 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 10:02:46.365120 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 10:02:46.365133 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":8,"thread_start_us":96,"threads_started":1}
I20260811 10:02:46.365356 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.363641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39852 (local address 127.9.127.193:33053)
0811 10:02:46.363884 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.363887 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.363896 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:46.363923 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.363925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.363933 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.364014 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.364896 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.364904 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.364904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.364909 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.364945 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.364972 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.365030 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.365261 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.365279 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":124,"threads_started":1}
I20260811 10:02:46.365662 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.363616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51140 (local address 127.9.127.194:43105)
0811 10:02:46.363979 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.363984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.363992 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:46.364017 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.364019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.364028 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.364118 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.364965 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.364971 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.364972 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.364976 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.365004 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.365022 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.365074 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.365555 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.365572 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":85,"threads_started":1}
I20260811 10:02:46.365492 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.363364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:43105 (local address 127.0.0.1:51140)
0811 10:02:46.363781 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.363793 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.363841 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.364372 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.364373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.364376 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:46.364858 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:02:46.364859 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:46.364866 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:02:46.364879 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:46.365097 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:46.365097 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:46.365098 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 10:02:46.365140 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 10:02:46.365412 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":107,"threads_started":1}
I20260811 10:02:46.365963 15506 tablet_service.cc:1467] Processing CreateTablet for tablet 462dd0e6950f42dd936e711a74fb5cb6 (DEFAULT_TABLE table=test-table [id=c7a604b7085f49708056ce8993b19f04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:46.366302 15506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462dd0e6950f42dd936e711a74fb5cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:46.366211 15208 tablet_service.cc:1467] Processing CreateTablet for tablet 462dd0e6950f42dd936e711a74fb5cb6 (DEFAULT_TABLE table=test-table [id=c7a604b7085f49708056ce8993b19f04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:46.366364 15356 tablet_service.cc:1467] Processing CreateTablet for tablet 462dd0e6950f42dd936e711a74fb5cb6 (DEFAULT_TABLE table=test-table [id=c7a604b7085f49708056ce8993b19f04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:46.366582 15208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462dd0e6950f42dd936e711a74fb5cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:46.366654 15356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 462dd0e6950f42dd936e711a74fb5cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:46.369030 15597 tablet_bootstrap.cc:492] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: Bootstrap starting.
I20260811 10:02:46.369685 15597 tablet_bootstrap.cc:654] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:46.369941 15598 tablet_bootstrap.cc:492] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96: Bootstrap starting.
I20260811 10:02:46.370015 15597 log.cc:824] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:46.370253 15599 tablet_bootstrap.cc:492] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: Bootstrap starting.
I20260811 10:02:46.370631 15598 tablet_bootstrap.cc:654] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:46.370831 15597 tablet_bootstrap.cc:492] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: No bootstrap required, opened a new log
I20260811 10:02:46.370921 15597 ts_tablet_manager.cc:1397] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:46.370981 15598 log.cc:824] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:46.371184 15599 tablet_bootstrap.cc:654] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:46.371549 15599 log.cc:824] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:46.373375 15598 tablet_bootstrap.cc:492] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96: No bootstrap required, opened a new log
I20260811 10:02:46.373443 15598 ts_tablet_manager.cc:1397] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 10:02:46.373391 15597 raft_consensus.cc:348] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.373601 15597 raft_consensus.cc:374] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:46.373646 15597 raft_consensus.cc:729] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df87f1d6f5054b7f8e49a6e3f7096be6, State: Initialized, Role: FOLLOWER
I20260811 10:02:46.373764 15597 consensus_queue.cc:260] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.374018 15597 ts_tablet_manager.cc:1428] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:02:46.374163 15582 heartbeater.cc:503] Master 127.9.127.254:45567 was elected leader, sending a full tablet report...
I20260811 10:02:46.374645 15599 tablet_bootstrap.cc:492] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: No bootstrap required, opened a new log
I20260811 10:02:46.374725 15599 ts_tablet_manager.cc:1397] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 10:02:46.376547 15598 raft_consensus.cc:348] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.376801 15598 raft_consensus.cc:374] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:46.376858 15598 raft_consensus.cc:729] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70b096b6b784dacbf8e2238ed8c1f96, State: Initialized, Role: FOLLOWER
I20260811 10:02:46.376837 15599 raft_consensus.cc:348] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.376994 15599 raft_consensus.cc:374] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:46.376996 15598 consensus_queue.cc:260] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.377043 15599 raft_consensus.cc:729] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d16a752d6c4068a66a01aa9c6e8b6d, State: Initialized, Role: FOLLOWER
I20260811 10:02:46.377158 15599 consensus_queue.cc:260] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.377264 15598 ts_tablet_manager.cc:1428] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 10:02:46.377410 15599 ts_tablet_manager.cc:1428] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:02:46.377435 15285 heartbeater.cc:503] Master 127.9.127.254:45567 was elected leader, sending a full tablet report...
I20260811 10:02:46.377547 15431 heartbeater.cc:503] Master 127.9.127.254:45567 was elected leader, sending a full tablet report...
I20260811 10:02:46.477669 15604 raft_consensus.cc:482] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:46.477841 15604 raft_consensus.cc:504] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.478317 15604 leader_election.cc:288] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d16a752d6c4068a66a01aa9c6e8b6d (127.9.127.194:43105), a70b096b6b784dacbf8e2238ed8c1f96 (127.9.127.193:33053)
W20260811 10:02:46.479736 15432 tablet.cc:2369] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:46.479840 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.478487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:43105 (local address 127.9.127.195:45695)
0811 10:02:46.478594 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.478606 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.478656 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.478956 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.478957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.478959 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:46.479505 (+ 546us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:02:46.479505 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:46.479510 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:02:46.479520 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:46.479707 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:46.479708 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:46.479709 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 10:02:46.479761 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 10:02:46.479781 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 10:02:46.479846 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.478550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:45695 (local address 127.9.127.194:43105)
0811 10:02:46.478599 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.478601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.478643 (+ 42us) server_negotiation.cc:407] Connection header received
0811 10:02:46.478733 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.478734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.478739 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.478804 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.479606 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.479608 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.479609 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.479613 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.479632 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.479637 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.479699 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.479763 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.479779 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 10:02:46.479874 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.478601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:58301 (local address 127.9.127.193:33053)
0811 10:02:46.478682 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.478686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.478720 (+ 34us) server_negotiation.cc:407] Connection header received
0811 10:02:46.478775 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.478776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.478781 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.478834 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.479620 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.479621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.479621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.479625 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.479642 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.479647 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.479699 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.479799 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.479812 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 10:02:46.480085 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.478519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:33053 (local address 127.9.127.195:58301)
0811 10:02:46.478669 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.478677 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.478725 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.478956 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.478957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.478959 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:46.479450 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:02:46.479450 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:46.479476 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:02:46.479494 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:46.479729 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:46.479730 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:46.479731 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 10:02:46.479985 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 10:02:46.480000 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260811 10:02:46.480158 15378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462dd0e6950f42dd936e711a74fb5cb6" candidate_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" is_pre_election: true
I20260811 10:02:46.480314 15378 raft_consensus.cc:2454] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df87f1d6f5054b7f8e49a6e3f7096be6 in term 0.
I20260811 10:02:46.480401 15232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462dd0e6950f42dd936e711a74fb5cb6" candidate_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" is_pre_election: true
I20260811 10:02:46.480584 15232 raft_consensus.cc:2454] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df87f1d6f5054b7f8e49a6e3f7096be6 in term 0.
I20260811 10:02:46.480567 15451 leader_election.cc:302] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df87f1d6f5054b7f8e49a6e3f7096be6, e5d16a752d6c4068a66a01aa9c6e8b6d; no voters:
I20260811 10:02:46.480693 15604 raft_consensus.cc:2781] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:46.480747 15604 raft_consensus.cc:482] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:46.480794 15604 raft_consensus.cc:3037] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:46.576699 15604 raft_consensus.cc:504] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.576989 15604 leader_election.cc:288] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [CANDIDATE]: Term 1 election: Requested vote from peers e5d16a752d6c4068a66a01aa9c6e8b6d (127.9.127.194:43105), a70b096b6b784dacbf8e2238ed8c1f96 (127.9.127.193:33053)
I20260811 10:02:46.577203 15378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462dd0e6950f42dd936e711a74fb5cb6" candidate_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d"
I20260811 10:02:46.577211 15232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "462dd0e6950f42dd936e711a74fb5cb6" candidate_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70b096b6b784dacbf8e2238ed8c1f96"
I20260811 10:02:46.577319 15378 raft_consensus.cc:3037] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:46.577329 15232 raft_consensus.cc:3037] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:46.578161 15378 raft_consensus.cc:2454] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df87f1d6f5054b7f8e49a6e3f7096be6 in term 1.
I20260811 10:02:46.578370 15451 leader_election.cc:302] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df87f1d6f5054b7f8e49a6e3f7096be6, e5d16a752d6c4068a66a01aa9c6e8b6d; no voters:
I20260811 10:02:46.578496 15604 raft_consensus.cc:2781] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:46.578541 15232 raft_consensus.cc:2454] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df87f1d6f5054b7f8e49a6e3f7096be6 in term 1.
I20260811 10:02:46.578660 15604 raft_consensus.cc:686] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 1 LEADER]: Becoming Leader. State: Replica: df87f1d6f5054b7f8e49a6e3f7096be6, State: Running, Role: LEADER
I20260811 10:02:46.578773 15604 consensus_queue.cc:237] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } }
I20260811 10:02:46.579777 15069 catalog_manager.cc:5495] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 reported cstate change: term changed from 0 to 1, leader changed from <none> to df87f1d6f5054b7f8e49a6e3f7096be6 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df87f1d6f5054b7f8e49a6e3f7096be6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:46.591115 15594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.590236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56842 (local address 127.9.127.195:41351)
0811 10:02:46.590292 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.590294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.590305 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:02:46.590341 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.590341 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.590352 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.590400 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.590964 (+ 564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.590965 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.590965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.590968 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.590980 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.590983 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.591021 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.591058 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.591069 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:02:46.592834 15232 raft_consensus.cc:1261] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [term 1 FOLLOWER]: Refusing update from remote peer df87f1d6f5054b7f8e49a6e3f7096be6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:46.592844 15378 raft_consensus.cc:1261] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 1 FOLLOWER]: Refusing update from remote peer df87f1d6f5054b7f8e49a6e3f7096be6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:46.593214 15608 consensus_queue.cc:1035] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70b096b6b784dacbf8e2238ed8c1f96" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:46.593338 15604 consensus_queue.cc:1035] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d16a752d6c4068a66a01aa9c6e8b6d" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:46.595923 15613 mvcc.cc:205] Tried to move back new op lower bound from 7317268752761511936 to 7317268752707313664. Current Snapshot: MvccSnapshot[applied={T|T < 7317268752761511936}]
I20260811 10:02:46.598757 15069 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:46.598855 15069 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:46.599651 15069 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4defce75e1d84dada9a51dddfa96a8e1: Sending DeleteTablet for 3 replicas of tablet 462dd0e6950f42dd936e711a74fb5cb6
I20260811 10:02:46.600004 15506 tablet_service.cc:1514] Processing DeleteTablet for tablet 462dd0e6950f42dd936e711a74fb5cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:46 UTC) from {username='slave'} at 127.0.0.1:56832
I20260811 10:02:46.600062 15208 tablet_service.cc:1514] Processing DeleteTablet for tablet 462dd0e6950f42dd936e711a74fb5cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:46 UTC) from {username='slave'} at 127.0.0.1:39852
I20260811 10:02:46.600072 15356 tablet_service.cc:1514] Processing DeleteTablet for tablet 462dd0e6950f42dd936e711a74fb5cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:46 UTC) from {username='slave'} at 127.0.0.1:51140
I20260811 10:02:46.600260 15622 tablet_replica.cc:330] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: stopping tablet replica
I20260811 10:02:46.600363 15622 raft_consensus.cc:2229] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:46.600390 15624 tablet_replica.cc:330] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: stopping tablet replica
I20260811 10:02:46.600489 15622 raft_consensus.cc:2258] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:46.600581 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 15137
I20260811 10:02:46.600632 15623 tablet_replica.cc:330] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96: stopping tablet replica
I20260811 10:02:46.600714 15623 raft_consensus.cc:2229] T 462dd0e6950f42dd936e711a74fb5cb6 P a70b096b6b784dacbf8e2238ed8c1f96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:46.602219 15622 ts_tablet_manager.cc:1905] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:46.605999 15624 raft_consensus.cc:2229] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:46.606163 15624 raft_consensus.cc:2258] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:46.606566 15624 ts_tablet_manager.cc:1905] T 462dd0e6950f42dd936e711a74fb5cb6 P e5d16a752d6c4068a66a01aa9c6e8b6d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 10:02:46.611009 15054 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:33053 (error 108)
I20260811 10:02:46.611055 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 15288
I20260811 10:02:46.615687 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.613975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:33053 (local address 127.0.0.1:39854)
0811 10:02:46.615584 (+ 1609us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.615641 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:33053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1575}
W20260811 10:02:46.615845 15054 catalog_manager.cc:4584] TS a70b096b6b784dacbf8e2238ed8c1f96 (127.9.127.193:33053): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 462dd0e6950f42dd936e711a74fb5cb6: Network error: Client connection negotiation failed: client connection to 127.9.127.193:33053: connect: Connection refused (error 111)
I20260811 10:02:46.668802 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.668610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:33053 (local address 127.0.0.1:39868)
0811 10:02:46.668689 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.668734 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:33053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 10:02:46.669270 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.669178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:33053 (local address 127.0.0.1:39884)
0811 10:02:46.669222 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.669250 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:33053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 10:02:46.678467 15622 ts_tablet_manager.cc:1918] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:46.678583 15622 log.cc:1196] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/462dd0e6950f42dd936e711a74fb5cb6
I20260811 10:02:46.678896 15622 ts_tablet_manager.cc:1939] T 462dd0e6950f42dd936e711a74fb5cb6 P df87f1d6f5054b7f8e49a6e3f7096be6: Deleting consensus metadata
I20260811 10:02:46.682147 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.682047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:43105 (local address 127.0.0.1:51146)
0811 10:02:46.682086 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.682109 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.194:43105: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 10:02:46.682255 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 15434
I20260811 10:02:46.709024 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 15035
I20260811 10:02:46.709084 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.708888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:41351 (local address 127.0.0.1:56852)
0811 10:02:46.709011 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.709043 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.195:41351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
2026-08-11T10:02:46Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (877 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 10:02:46.731895 9727 mini_oidc.cc:152] Starting JWKS server
I20260811 10:02:46.733258 9727 webserver.cc:460] Webserver started at https://127.0.0.1:39403/ using document root <none> and password file <none>
I20260811 10:02:46.733383 9727 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 10:02:46.733570 9727 webserver.cc:460] Webserver started at http://127.0.0.1:33847/ using document root <none> and password file <none>
2026-08-11T10:02:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:46Z Disabled control of system clock
I20260811 10:02:46.742883 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41951
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:41951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:41951
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39403/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/testchainca.cert with env {}
W20260811 10:02:46.830296 15633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:46.830605 15633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:46.830646 15633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:46.832372 15633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:46.832434 15633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:46.832448 15633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:46.832492 15633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:46.832526 15633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 10:02:46.832547 15633 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 10:02:46.832567 15633 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39403/jwks.json
I20260811 10:02:46.835043 15633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:41951
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39403/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:46.835338 15633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:46.835629 15633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:46.841259 15638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:46.841301 15641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:46.841266 15639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:46.841630 15633 server_base.cc:1034] running on GCE node
I20260811 10:02:46.841933 15633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:46.842254 15633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:46.843446 15633 hybrid_clock.cc:648] HybridClock initialized: now 1786442566843429 us; error 25 us; skew 500 ppm
I20260811 10:02:46.845073 15633 webserver.cc:460] Webserver started at http://127.9.127.254:38951/ using document root <none> and password file <none>
I20260811 10:02:46.845376 15633 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:46.845466 15633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:46.845641 15633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:46.846818 15633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "91902e076b404cfd89687f2f7f10d327"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "741c36f295af9b658ecb05d200fea3dd"
server_key_iv: "33b5f13b043ce070ed1a92d5b336a733"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.847294 15633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "91902e076b404cfd89687f2f7f10d327"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "741c36f295af9b658ecb05d200fea3dd"
server_key_iv: "33b5f13b043ce070ed1a92d5b336a733"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.848769 15633 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:46.849690 15649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:46.849871 15633 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:46.850001 15633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "91902e076b404cfd89687f2f7f10d327"
format_stamp: "Formatted at 2026-08-11 10:02:46 on dist-test-slave-1x4g"
server_key: "741c36f295af9b658ecb05d200fea3dd"
server_key_iv: "33b5f13b043ce070ed1a92d5b336a733"
server_key_version: "encryptionkey@0"
I20260811 10:02:46.850087 15633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:46.863762 15633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:46.864060 15633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:46.864212 15633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:46.868412 15633 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:41951
I20260811 10:02:46.868467 15710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:41951 every 8 connection(s)
I20260811 10:02:46.868870 15633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:46.869946 15711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:46.872612 15711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327: Bootstrap starting.
I20260811 10:02:46.873333 15711 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:46.873656 15711 log.cc:824] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:46.874447 15711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327: No bootstrap required, opened a new log
I20260811 10:02:46.876084 15711 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91902e076b404cfd89687f2f7f10d327" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41951 } }
I20260811 10:02:46.876219 15711 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:46.876241 15711 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91902e076b404cfd89687f2f7f10d327, State: Initialized, Role: FOLLOWER
I20260811 10:02:46.876402 15711 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91902e076b404cfd89687f2f7f10d327" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41951 } }
I20260811 10:02:46.876490 15711 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:46.876557 15711 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:46.876610 15711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:46.877748 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 15633
I20260811 10:02:46.877875 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:46.878054 9727 external_mini_cluster.cc:1428] Setting key 5e361cd8bf85b14fa4e12ff82ad489f7
I20260811 10:02:46.878654 15711 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91902e076b404cfd89687f2f7f10d327" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41951 } }
I20260811 10:02:46.878788 15711 leader_election.cc:302] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91902e076b404cfd89687f2f7f10d327; no voters:
I20260811 10:02:46.878973 15711 leader_election.cc:288] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:46.879017 15719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:46.879156 15719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [term 1 LEADER]: Becoming Leader. State: Replica: 91902e076b404cfd89687f2f7f10d327, State: Running, Role: LEADER
I20260811 10:02:46.879243 15711 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:46.879238 15719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91902e076b404cfd89687f2f7f10d327" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41951 } }
I20260811 10:02:46.879796 15720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91902e076b404cfd89687f2f7f10d327. Latest consensus state: current_term: 1 leader_uuid: "91902e076b404cfd89687f2f7f10d327" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91902e076b404cfd89687f2f7f10d327" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41951 } } }
I20260811 10:02:46.879877 15720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:46.880108 15726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:46.880890 15726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:46.881258 15721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91902e076b404cfd89687f2f7f10d327" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91902e076b404cfd89687f2f7f10d327" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41951 } } }
I20260811 10:02:46.881420 15721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:46.882925 15726 catalog_manager.cc:1347] Generated new cluster ID: cc50f6d0565049a784439372051e66e6
I20260811 10:02:46.882980 15726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:46.887401 15717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.878592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45484 (local address 127.9.127.254:41951)
0811 10:02:46.882028 (+ 3436us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.882036 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.882067 (+ 31us) server_negotiation.cc:407] Connection header received
0811 10:02:46.882192 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.882198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.882279 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.882426 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:46.882783 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:46.884386 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:46.885342 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:46.885748 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:46.885879 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:46.886639 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:46.886643 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:46.886643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:46.886823 (+ 180us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:46.886857 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:46.886867 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:46.886943 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:46.887013 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 10:02:46.887091 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3355,"thread_start_us":85,"threads_started":1}
I20260811 10:02:46.888302 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:02:46.894135 15726 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:46.894804 15726 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:46.897140 15726 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91902e076b404cfd89687f2f7f10d327: Generated new TSK 0
I20260811 10:02:46.897298 15726 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 10:02:46.919643 15745 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 10:02:46.919790 15745 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 10:02:46.920017 15717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:46.904707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45488 (local address 127.9.127.254:41951)
0811 10:02:46.904753 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:46.904755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:46.904934 (+ 179us) server_negotiation.cc:407] Connection header received
0811 10:02:46.905019 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:46.905020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:46.905030 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:46.905089 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0811 10:02:46.905216 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:46.905642 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:46.906789 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:46.906979 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:46.907041 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:46.907271 (+ 230us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 10:02:46.919801 (+ 12530us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39403/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 10:02:46.919974 (+ 173us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39403/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 10:02:46.920104 15717 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39403/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 10:02:46.920578 15744 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:46.904650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:41951 (local address 127.0.0.1:45488)
0811 10:02:46.904850 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:46.904861 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:46.904933 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:46.905096 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:46.905098 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:46.905100 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 10:02:46.905154 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:46.905156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:46.905733 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:46.905734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:46.906694 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:46.906697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:46.907062 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:46.907063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:46.907124 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:46.907145 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 10:02:46.919961 (+ 12816us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39403/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 10:02:46.920096 (+ 135us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.127.254:41951: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39403/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":92,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.9.127.254:41951: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39403/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 10:02:46.921168 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 15633
2026-08-11T10:02:46Z chronyd exiting
I20260811 10:02:46.961613 9727 test_util.cc:175] -----------------------------------------------
I20260811 10:02:46.961707 9727 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786442543469380-9727-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (230 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 10:02:46.962646 9727 mini_oidc.cc:152] Starting JWKS server
I20260811 10:02:46.963305 9727 webserver.cc:460] Webserver started at https://127.0.0.1:35359/ using document root <none> and password file <none>
I20260811 10:02:46.963372 9727 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 10:02:46.963547 9727 webserver.cc:460] Webserver started at http://127.0.0.1:38785/ using document root <none> and password file <none>
2026-08-11T10:02:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:46Z Disabled control of system clock
I20260811 10:02:46.973600 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:40969
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:43107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:40969
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35359/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/testchainca.cert with env {}
W20260811 10:02:47.058830 15751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:47.059047 15751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:47.059069 15751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:47.060261 15751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:47.060298 15751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:47.060310 15751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:47.060321 15751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:47.060333 15751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 10:02:47.060375 15751 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 10:02:47.060390 15751 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35359/jwks.json
I20260811 10:02:47.062011 15751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:40969
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:40969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35359/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:47.062301 15751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:47.062515 15751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:47.067350 15756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:47.067379 15758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:47.067354 15760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:47.067616 15751 server_base.cc:1034] running on GCE node
I20260811 10:02:47.067837 15751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:47.068117 15751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:47.069270 15751 hybrid_clock.cc:648] HybridClock initialized: now 1786442567069256 us; error 29 us; skew 500 ppm
I20260811 10:02:47.070760 15751 webserver.cc:460] Webserver started at http://127.9.127.254:33015/ using document root <none> and password file <none>
I20260811 10:02:47.071035 15751 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:47.071113 15751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:47.071265 15751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:47.072347 15751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "0abc52699b7e47aab9e776ed09680145"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "4ac882f20865607e33945f71b07e2145"
server_key_iv: "837c0f7620de3facd980256aebdef502"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.072733 15751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "0abc52699b7e47aab9e776ed09680145"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "4ac882f20865607e33945f71b07e2145"
server_key_iv: "837c0f7620de3facd980256aebdef502"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.074100 15751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:47.074862 15767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:47.075073 15751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:47.075202 15751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "0abc52699b7e47aab9e776ed09680145"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "4ac882f20865607e33945f71b07e2145"
server_key_iv: "837c0f7620de3facd980256aebdef502"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.075277 15751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:47.096395 15751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:47.096735 15751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:47.096911 15751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:47.100909 15751 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:40969
I20260811 10:02:47.100973 15827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:40969 every 8 connection(s)
I20260811 10:02:47.101343 15751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:47.102337 15829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:47.104625 15829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145: Bootstrap starting.
I20260811 10:02:47.105269 15829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:47.105515 15829 log.cc:824] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:47.106191 15829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145: No bootstrap required, opened a new log
I20260811 10:02:47.107718 15829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abc52699b7e47aab9e776ed09680145" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 40969 } }
I20260811 10:02:47.107897 15829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:47.107924 15829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0abc52699b7e47aab9e776ed09680145, State: Initialized, Role: FOLLOWER
I20260811 10:02:47.108108 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 15751
I20260811 10:02:47.108109 15829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abc52699b7e47aab9e776ed09680145" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 40969 } }
I20260811 10:02:47.108209 15829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:47.108217 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:47.108258 15829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:47.108325 15829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:47.108421 9727 external_mini_cluster.cc:1428] Setting key 60e2a8d8224f4a5419be755b9a540b6f
I20260811 10:02:47.113322 15833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:47.108948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37292 (local address 127.9.127.254:40969)
0811 10:02:47.109175 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:47.109181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:47.109206 (+ 25us) server_negotiation.cc:407] Connection header received
0811 10:02:47.109296 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:47.109301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:47.109349 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:47.109455 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:47.109652 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.110469 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.111341 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.111749 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.111848 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.112533 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:47.112537 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:47.112537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:47.112705 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:47.112739 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:47.112749 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:47.112877 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:47.112972 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 10:02:47.113058 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":109,"threads_started":1}
I20260811 10:02:47.114279 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:02:47.181934 15829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abc52699b7e47aab9e776ed09680145" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 40969 } }
I20260811 10:02:47.182109 15829 leader_election.cc:302] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0abc52699b7e47aab9e776ed09680145; no voters:
I20260811 10:02:47.182377 15829 leader_election.cc:288] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:47.182461 15835 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:47.182659 15835 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [term 1 LEADER]: Becoming Leader. State: Replica: 0abc52699b7e47aab9e776ed09680145, State: Running, Role: LEADER
I20260811 10:02:47.182731 15829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:47.182824 15835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abc52699b7e47aab9e776ed09680145" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 40969 } }
I20260811 10:02:47.183252 15836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0abc52699b7e47aab9e776ed09680145" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abc52699b7e47aab9e776ed09680145" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 40969 } } }
I20260811 10:02:47.183357 15836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:47.183517 15837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0abc52699b7e47aab9e776ed09680145. Latest consensus state: current_term: 1 leader_uuid: "0abc52699b7e47aab9e776ed09680145" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abc52699b7e47aab9e776ed09680145" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 40969 } } }
I20260811 10:02:47.183593 15837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:47.183604 15844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:47.184154 15844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:47.186079 15844 catalog_manager.cc:1347] Generated new cluster ID: b28c532f82c5404abc87db0f24386ad3
I20260811 10:02:47.186141 15844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:47.204123 15844 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:47.204680 15844 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:47.207870 15844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0abc52699b7e47aab9e776ed09680145: Generated new TSK 0
I20260811 10:02:47.208086 15844 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 10:02:47.232636 15860 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 10:02:47.232718 15860 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 10:02:47.233055 15833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:47.218592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37294 (local address 127.9.127.254:40969)
0811 10:02:47.218662 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:47.218665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:47.218814 (+ 149us) server_negotiation.cc:407] Connection header received
0811 10:02:47.218871 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:47.218872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:47.218885 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:47.218969 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0811 10:02:47.219129 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.219643 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.220852 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.221071 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.221126 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.221316 (+ 190us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 10:02:47.232881 (+ 11565us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 10:02:47.233008 (+ 127us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37294: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 10:02:47.233126 15833 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37294: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 10:02:47.233247 15859 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:47.218538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:40969 (local address 127.0.0.1:37294)
0811 10:02:47.218717 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:47.218730 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:47.218801 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:47.218987 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:47.218988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:47.218990 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 10:02:47.219055 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:47.219058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.219725 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.219727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:47.220706 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:47.220709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.221152 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.221153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:47.221217 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.221223 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 10:02:47.233006 (+ 11783us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 10:02:47.233121 (+ 115us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.127.254:40969: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":107,"threads_started":1}
I20260811 10:02:47.233623 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 15751
2026-08-11T10:02:47Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (312 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 10:02:47.274838 9727 mini_oidc.cc:152] Starting JWKS server
I20260811 10:02:47.275527 9727 webserver.cc:460] Webserver started at https://127.0.0.1:39545/ using document root <none> and password file <none>
I20260811 10:02:47.275570 9727 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 10:02:47.275758 9727 webserver.cc:460] Webserver started at http://127.0.0.1:43925/ using document root <none> and password file <none>
2026-08-11T10:02:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:47Z Disabled control of system clock
I20260811 10:02:47.284842 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41015
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:41923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:41015
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39545/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 10:02:47.365736 15867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:47.365953 15867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:47.365974 15867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:47.367070 15867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:47.367105 15867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:47.367117 15867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:47.367129 15867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:47.367142 15867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 10:02:47.367154 15867 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 10:02:47.367172 15867 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39545/jwks.json
I20260811 10:02:47.368465 15867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:41015
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39545/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:47.368657 15867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:47.369014 15867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:47.373643 15876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:47.373629 15874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:47.373656 15872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:47.373953 15867 server_base.cc:1034] running on GCE node
I20260811 10:02:47.374190 15867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:47.374495 15867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:47.375659 15867 hybrid_clock.cc:648] HybridClock initialized: now 1786442567375653 us; error 37 us; skew 500 ppm
I20260811 10:02:47.377000 15867 webserver.cc:460] Webserver started at http://127.9.127.254:45679/ using document root <none> and password file <none>
I20260811 10:02:47.377234 15867 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:47.377305 15867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:47.377439 15867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:47.378602 15867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "6fdc67bf07b246e5b7a118f3c757ab8e"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "abe7abfdf9639ed788676f3124d1ad3c"
server_key_iv: "11acb903c0d3ffc1c156eedd8bd1a39d"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.379010 15867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "6fdc67bf07b246e5b7a118f3c757ab8e"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "abe7abfdf9639ed788676f3124d1ad3c"
server_key_iv: "11acb903c0d3ffc1c156eedd8bd1a39d"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.380501 15867 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:47.381338 15882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:47.381526 15867 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:47.381639 15867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6fdc67bf07b246e5b7a118f3c757ab8e"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "abe7abfdf9639ed788676f3124d1ad3c"
server_key_iv: "11acb903c0d3ffc1c156eedd8bd1a39d"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.381728 15867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:47.391980 15867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:47.392297 15867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:47.392449 15867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:47.396482 15867 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:41015
I20260811 10:02:47.396520 15942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:41015 every 8 connection(s)
I20260811 10:02:47.396947 15867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:47.397642 15943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:47.399488 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 15867
I20260811 10:02:47.399591 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:47.399792 9727 external_mini_cluster.cc:1428] Setting key 81cd81d7d349b4fda24d451b0efb8716
I20260811 10:02:47.400753 15943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e: Bootstrap starting.
I20260811 10:02:47.401399 15943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:47.401707 15943 log.cc:824] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:47.402493 15943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e: No bootstrap required, opened a new log
I20260811 10:02:47.404124 15943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fdc67bf07b246e5b7a118f3c757ab8e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41015 } }
I20260811 10:02:47.404328 15943 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:47.404368 15943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fdc67bf07b246e5b7a118f3c757ab8e, State: Initialized, Role: FOLLOWER
I20260811 10:02:47.404503 15943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fdc67bf07b246e5b7a118f3c757ab8e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41015 } }
I20260811 10:02:47.404595 15943 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:47.404620 15943 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:47.404690 15943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:47.405452 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:47.400275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48110 (local address 127.9.127.254:41015)
0811 10:02:47.400478 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:47.400486 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:47.400516 (+ 30us) server_negotiation.cc:407] Connection header received
0811 10:02:47.401041 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:47.401049 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:47.401115 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:47.401262 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:47.401463 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.402654 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.403422 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.403834 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.403970 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.404724 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:47.404728 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:47.404729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:47.404944 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:47.404978 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:47.404988 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:47.405038 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:47.405173 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 10:02:47.405256 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260811 10:02:47.406418 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:02:47.491667 15943 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fdc67bf07b246e5b7a118f3c757ab8e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41015 } }
I20260811 10:02:47.491878 15943 leader_election.cc:302] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fdc67bf07b246e5b7a118f3c757ab8e; no voters:
I20260811 10:02:47.492175 15943 leader_election.cc:288] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:47.492246 15949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:47.492431 15949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [term 1 LEADER]: Becoming Leader. State: Replica: 6fdc67bf07b246e5b7a118f3c757ab8e, State: Running, Role: LEADER
I20260811 10:02:47.492520 15943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:47.492542 15949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fdc67bf07b246e5b7a118f3c757ab8e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41015 } }
I20260811 10:02:47.493059 15950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fdc67bf07b246e5b7a118f3c757ab8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fdc67bf07b246e5b7a118f3c757ab8e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41015 } } }
I20260811 10:02:47.493170 15950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:47.493405 15951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fdc67bf07b246e5b7a118f3c757ab8e. Latest consensus state: current_term: 1 leader_uuid: "6fdc67bf07b246e5b7a118f3c757ab8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fdc67bf07b246e5b7a118f3c757ab8e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41015 } } }
I20260811 10:02:47.493774 15951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:47.493927 15955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:47.494454 15955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:47.497218 15955 catalog_manager.cc:1347] Generated new cluster ID: f312f5862ab8427dbbb7e311ab466397
I20260811 10:02:47.497277 15955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:47.519119 15955 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:47.519634 15955 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:47.524598 15955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fdc67bf07b246e5b7a118f3c757ab8e: Generated new TSK 0
I20260811 10:02:47.524808 15955 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:02:47.538784 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:47.535057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48120 (local address 127.9.127.254:41015)
0811 10:02:47.535128 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:47.535130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:47.535189 (+ 59us) server_negotiation.cc:407] Connection header received
0811 10:02:47.535258 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:47.535258 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:47.535280 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:47.535343 (+ 63us) server_negotiation.cc:226] Negotiated authn=JWT
0811 10:02:47.535504 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.536002 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.537174 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.537363 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.537417 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.537619 (+ 202us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 10:02:47.538572 (+ 953us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39545/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 10:02:47.538719 (+ 147us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48120: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39545/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 10:02:47.538843 15947 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48120: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39545/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 10:02:47.539162 15976 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:47.534987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:41015 (local address 127.0.0.1:48120)
0811 10:02:47.535123 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:47.535132 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:47.535190 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:47.535362 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:47.535363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:47.535365 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 10:02:47.535439 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:47.535441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.536104 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.536105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:47.537090 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:47.537093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.537442 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.537443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:47.537515 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.537521 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 10:02:47.538696 (+ 1175us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39545/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 10:02:47.538796 (+ 100us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.127.254:41015: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39545/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":76,"threads_started":1}
I20260811 10:02:47.539378 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 15867
E20260811 10:02:47.551024 15977 webserver.cc:533] Webserver: sslize failed:
E20260811 10:02:47.551112 15977 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T10:02:47Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (304 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T10:02:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:47Z Disabled control of system clock
I20260811 10:02:47.587893 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:32969
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:37779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:32969
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/testchainca.cert with env {}
W20260811 10:02:47.671279 15982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:47.671518 15982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:47.671553 15982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:47.672708 15982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:47.672777 15982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:47.672849 15982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:47.672883 15982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:47.672905 15982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 10:02:47.672926 15982 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 10:02:47.672951 15982 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 10:02:47.674479 15982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:32969
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:32969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:47.674774 15982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:47.675016 15982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:47.679929 15987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:47.680562 15991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:47.680660 15988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:47.680697 15982 server_base.cc:1034] running on GCE node
I20260811 10:02:47.680939 15982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:47.681248 15982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:47.682391 15982 hybrid_clock.cc:648] HybridClock initialized: now 1786442567682379 us; error 30 us; skew 500 ppm
I20260811 10:02:47.683630 15982 webserver.cc:460] Webserver started at http://127.9.127.254:43797/ using document root <none> and password file <none>
I20260811 10:02:47.683869 15982 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:47.683921 15982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:47.684123 15982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:47.685192 15982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "c271d437639243e5b6515b24d2d701eb"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "934b918ba77c2047615f8809c77ba163"
server_key_iv: "20d226e297244a890a6335a02e0f6f69"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.685534 15982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "c271d437639243e5b6515b24d2d701eb"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "934b918ba77c2047615f8809c77ba163"
server_key_iv: "20d226e297244a890a6335a02e0f6f69"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.686803 15982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:02:47.687505 15999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:47.687688 15982 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:47.687776 15982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "c271d437639243e5b6515b24d2d701eb"
format_stamp: "Formatted at 2026-08-11 10:02:47 on dist-test-slave-1x4g"
server_key: "934b918ba77c2047615f8809c77ba163"
server_key_iv: "20d226e297244a890a6335a02e0f6f69"
server_key_version: "encryptionkey@0"
I20260811 10:02:47.687847 15982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:47.697681 15982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:47.697970 15982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:47.698125 15982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:47.702872 15982 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:32969
I20260811 10:02:47.702920 16060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:32969 every 8 connection(s)
I20260811 10:02:47.703241 15982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:47.704187 16061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:47.706533 16061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb: Bootstrap starting.
I20260811 10:02:47.707139 16061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:47.707490 16061 log.cc:824] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:47.708174 16061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb: No bootstrap required, opened a new log
I20260811 10:02:47.709848 16061 raft_consensus.cc:348] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c271d437639243e5b6515b24d2d701eb" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 32969 } }
I20260811 10:02:47.710021 16061 raft_consensus.cc:374] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:47.710098 16061 raft_consensus.cc:729] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c271d437639243e5b6515b24d2d701eb, State: Initialized, Role: FOLLOWER
I20260811 10:02:47.710263 16061 consensus_queue.cc:260] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c271d437639243e5b6515b24d2d701eb" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 32969 } }
I20260811 10:02:47.710345 16061 raft_consensus.cc:388] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:47.710387 16061 raft_consensus.cc:482] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:47.710438 16061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:47.712108 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 15982
I20260811 10:02:47.712194 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:47.712328 9727 external_mini_cluster.cc:1428] Setting key b961bba18d560a6d4b75a223ed518b49
I20260811 10:02:47.717036 16065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:47.712826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46150 (local address 127.9.127.254:32969)
0811 10:02:47.713037 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:47.713043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:47.713067 (+ 24us) server_negotiation.cc:407] Connection header received
0811 10:02:47.713157 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:47.713163 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:47.713211 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:47.713319 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:47.713509 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.714606 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.715316 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.715698 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.715784 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.716415 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:47.716418 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:47.716418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:02:47.716580 (+ 162us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:47.716610 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:02:47.716619 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:47.716681 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:47.716760 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 10:02:47.716874 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260811 10:02:47.717947 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:02:47.799419 16061 raft_consensus.cc:504] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c271d437639243e5b6515b24d2d701eb" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 32969 } }
I20260811 10:02:47.799628 16061 leader_election.cc:302] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c271d437639243e5b6515b24d2d701eb; no voters:
I20260811 10:02:47.799886 16061 leader_election.cc:288] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:47.799973 16066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:47.800164 16066 raft_consensus.cc:686] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [term 1 LEADER]: Becoming Leader. State: Replica: c271d437639243e5b6515b24d2d701eb, State: Running, Role: LEADER
I20260811 10:02:47.800235 16061 sys_catalog.cc:564] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:47.800282 16066 consensus_queue.cc:237] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c271d437639243e5b6515b24d2d701eb" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 32969 } }
I20260811 10:02:47.800722 16068 sys_catalog.cc:455] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader c271d437639243e5b6515b24d2d701eb. Latest consensus state: current_term: 1 leader_uuid: "c271d437639243e5b6515b24d2d701eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c271d437639243e5b6515b24d2d701eb" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 32969 } } }
I20260811 10:02:47.800820 16067 sys_catalog.cc:455] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c271d437639243e5b6515b24d2d701eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c271d437639243e5b6515b24d2d701eb" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 32969 } } }
I20260811 10:02:47.801011 16067 sys_catalog.cc:458] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:47.800938 16068 sys_catalog.cc:458] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:47.801270 16077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:47.801795 16077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:47.805097 16077 catalog_manager.cc:1347] Generated new cluster ID: 640c573194cb4f6a83271ae2ab89d3df
I20260811 10:02:47.805159 16077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:47.822621 16077 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:47.823318 16077 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:47.834075 16077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c271d437639243e5b6515b24d2d701eb: Generated new TSK 0
I20260811 10:02:47.834273 16077 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:02:48.360492 16065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:47.838888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46162 (local address 127.9.127.254:32969)
0811 10:02:47.838979 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:47.838981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:47.839081 (+ 100us) server_negotiation.cc:407] Connection header received
0811 10:02:47.839123 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:47.839124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:47.839137 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:47.839226 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0811 10:02:47.839357 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.840130 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.840949 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.841257 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.841325 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.841501 (+ 176us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 10:02:48.360258 (+518757us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 10:02:48.360425 (+ 167us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46162: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 10:02:48.360559 16065 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46162: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 10:02:48.360702 16094 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:47.838781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:32969 (local address 127.0.0.1:46162)
0811 10:02:47.838997 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:47.839006 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:47.839062 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:47.839230 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:47.839231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:47.839233 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 10:02:47.839287 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:47.839288 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.840209 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.840209 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:47.840855 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:47.840858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:47.841351 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:47.841352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:47.841393 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:47.841397 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 10:02:48.360409 (+519012us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 10:02:48.360567 (+ 158us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.9.127.254:32969: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":88,"threads_started":1}
I20260811 10:02:48.361083 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 15982
2026-08-11T10:02:48Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (802 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (91 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (87 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:48 dist-test-slave-1x4g krb5kdc[16109](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:48 dist-test-slave-1x4g krb5kdc[16109](info): set up 2 sockets
Aug 11 10:02:48 dist-test-slave-1x4g krb5kdc[16109](info): commencing operation
krb5kdc: starting...
W20260811 10:02:49.599898 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:49 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:49.714841 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:42007
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:36799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:42007
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:49.793494 16124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:49.793733 16124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:49.793771 16124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:49.794817 16124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:49.794878 16124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:49.794900 16124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:49.794921 16124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:49.794947 16124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:49.796337 16124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:36799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:42007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:42007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:49.796612 16124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:49.796880 16124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:49.801606 16130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:49.801657 16132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:49.801613 16129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:49.801769 16124 server_base.cc:1034] running on GCE node
I20260811 10:02:49.802052 16124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:49.802368 16124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:49.803529 16124 hybrid_clock.cc:648] HybridClock initialized: now 1786442569803513 us; error 45 us; skew 500 ppm
Aug 11 10:02:49 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442569, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:49.805819 16124 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:02:49.806246 16124 webserver.cc:460] Webserver started at http://127.9.127.254:36817/ using document root <none> and password file <none>
I20260811 10:02:49.806499 16124 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:49.806560 16124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:49.806708 16124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:49.807711 16124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "4586b110469b435e82a78a55a4496a2c"
format_stamp: "Formatted at 2026-08-11 10:02:49 on dist-test-slave-1x4g"
server_key: "485fe809ca3212b1f6a4124df6993ddc"
server_key_iv: "48b7273fc35e3026636868b0a0e8aaab"
server_key_version: "encryptionkey@0"
I20260811 10:02:49.808053 16124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "4586b110469b435e82a78a55a4496a2c"
format_stamp: "Formatted at 2026-08-11 10:02:49 on dist-test-slave-1x4g"
server_key: "485fe809ca3212b1f6a4124df6993ddc"
server_key_iv: "48b7273fc35e3026636868b0a0e8aaab"
server_key_version: "encryptionkey@0"
I20260811 10:02:49.809362 16124 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:49.810040 16139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:49.810213 16124 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:49.810317 16124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "4586b110469b435e82a78a55a4496a2c"
format_stamp: "Formatted at 2026-08-11 10:02:49 on dist-test-slave-1x4g"
server_key: "485fe809ca3212b1f6a4124df6993ddc"
server_key_iv: "48b7273fc35e3026636868b0a0e8aaab"
server_key_version: "encryptionkey@0"
I20260811 10:02:49.810387 16124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:49.831512 16124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:49.833364 16124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:49.833528 16124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:49.837657 16124 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:42007
I20260811 10:02:49.837695 16196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:42007 every 8 connection(s)
I20260811 10:02:49.838053 16124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:49.838881 16197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:49.839108 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 16124
I20260811 10:02:49.839218 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:49.839422 9727 external_mini_cluster.cc:1428] Setting key 6275c223e018389bdc8e3867dcb317f6
I20260811 10:02:49.841924 16197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c: Bootstrap starting.
I20260811 10:02:49.842549 16197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:49.842839 16197 log.cc:824] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:49.843498 16197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c: No bootstrap required, opened a new log
I20260811 10:02:49.845667 16197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4586b110469b435e82a78a55a4496a2c" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42007 } }
I20260811 10:02:49.845837 16197 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:49.845872 16197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4586b110469b435e82a78a55a4496a2c, State: Initialized, Role: FOLLOWER
Aug 11 10:02:49 dist-test-slave-1x4g krb5kdc[16109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:49.845996 16197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4586b110469b435e82a78a55a4496a2c" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42007 } }
I20260811 10:02:49.846088 16197 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:49.846112 16197 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:49.846181 16197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:49.846711 16197 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4586b110469b435e82a78a55a4496a2c" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42007 } }
I20260811 10:02:49.846848 16197 leader_election.cc:302] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4586b110469b435e82a78a55a4496a2c; no voters:
I20260811 10:02:49.847012 16197 leader_election.cc:288] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:49.847111 16203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:49.847314 16203 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [term 1 LEADER]: Becoming Leader. State: Replica: 4586b110469b435e82a78a55a4496a2c, State: Running, Role: LEADER
I20260811 10:02:49.847362 16197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:49.847512 16203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4586b110469b435e82a78a55a4496a2c" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42007 } }
I20260811 10:02:49.847903 16207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4586b110469b435e82a78a55a4496a2c. Latest consensus state: current_term: 1 leader_uuid: "4586b110469b435e82a78a55a4496a2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4586b110469b435e82a78a55a4496a2c" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42007 } } }
I20260811 10:02:49.848023 16207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:49.848222 16204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4586b110469b435e82a78a55a4496a2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4586b110469b435e82a78a55a4496a2c" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42007 } } }
I20260811 10:02:49.848362 16204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:49.848459 16214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:49.848976 16214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:49.850497 16214 catalog_manager.cc:1347] Generated new cluster ID: 197b60c99d2344dbb6706757611a1c77
I20260811 10:02:49.850546 16214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:49.851624 16200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:49.840009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47038 (local address 127.9.127.254:42007)
0811 10:02:49.840184 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:49.840193 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:49.840226 (+ 33us) server_negotiation.cc:407] Connection header received
0811 10:02:49.840624 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:49.840631 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:49.840673 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:49.840837 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:49.841645 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:49.842574 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:49.843376 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:49.843844 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:49.843961 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:49.846502 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:49.846506 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:49.846506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:49.846517 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:49.849706 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:49.850136 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:49.850140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:49.850140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:49.850240 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:49.850462 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:49.850462 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:49.850463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:49.850749 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:49.851237 (+ 488us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:49.851303 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 10:02:49.851422 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
I20260811 10:02:49.860378 16214 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:49.861147 16214 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:49.865900 16214 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4586b110469b435e82a78a55a4496a2c: Generated new TSK 0
I20260811 10:02:49.866056 16214 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:02:49.895514 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42007
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:36799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:49.973948 16226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:49.974165 16226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:49.974205 16226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:49.975356 16226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:49.975422 16226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:49.975466 16226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:49.977785 16226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:36799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:49.978056 16226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:49.978313 16226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:49.983505 16232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:49.983470 16235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:49.983517 16233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:49.983801 16226 server_base.cc:1034] running on GCE node
I20260811 10:02:49.984056 16226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:49.984302 16226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:49.985456 16226 hybrid_clock.cc:648] HybridClock initialized: now 1786442569985449 us; error 34 us; skew 500 ppm
Aug 11 10:02:49 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442569, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:49.987768 16226 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:02:49.988199 16226 webserver.cc:460] Webserver started at http://127.9.127.193:45293/ using document root <none> and password file <none>
I20260811 10:02:49.988421 16226 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:49.988488 16226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:49.988626 16226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:49.989668 16226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "b45c305ab7f3486192df3e7be14c9ce3"
format_stamp: "Formatted at 2026-08-11 10:02:49 on dist-test-slave-1x4g"
server_key: "f29a609034601e1459dab587934ca467"
server_key_iv: "617d0a11e27a250e7673a4acbc65a80e"
server_key_version: "encryptionkey@0"
I20260811 10:02:49.990023 16226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "b45c305ab7f3486192df3e7be14c9ce3"
format_stamp: "Formatted at 2026-08-11 10:02:49 on dist-test-slave-1x4g"
server_key: "f29a609034601e1459dab587934ca467"
server_key_iv: "617d0a11e27a250e7673a4acbc65a80e"
server_key_version: "encryptionkey@0"
I20260811 10:02:49.991528 16226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:02:49.992189 16243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:49.992362 16226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:49.992460 16226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "b45c305ab7f3486192df3e7be14c9ce3"
format_stamp: "Formatted at 2026-08-11 10:02:49 on dist-test-slave-1x4g"
server_key: "f29a609034601e1459dab587934ca467"
server_key_iv: "617d0a11e27a250e7673a4acbc65a80e"
server_key_version: "encryptionkey@0"
I20260811 10:02:49.992542 16226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:50.018141 16226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:50.019836 16226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:50.019999 16226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:50.020224 16226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:50.020524 16226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:50.020576 16226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:50.020617 16226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:50.020645 16226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:50.026470 16226 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:33107
I20260811 10:02:50.026535 16368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:33107 every 8 connection(s)
I20260811 10:02:50.026827 16226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:50.030296 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 16226
I20260811 10:02:50.030417 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:50.030599 9727 external_mini_cluster.cc:1428] Setting key d8b04aba1e4a343e73f09fadb9668e4d
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442569, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:50.037030 16200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.027523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:51365 (local address 127.9.127.254:42007)
0811 10:02:50.027607 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.027610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.027803 (+ 193us) server_negotiation.cc:407] Connection header received
0811 10:02:50.028813 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.028814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.028828 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.028884 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.029547 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.030054 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.031494 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.031836 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.031913 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.034114 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:50.034116 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:50.034116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:50.034126 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:50.035490 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.035971 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.035972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.035972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.036024 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.036324 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.036324 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.036325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.036425 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:50.036476 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:50.036880 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 10:02:50.036963 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 10:02:50.037343 16372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.027476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42007 (local address 127.9.127.193:51365)
0811 10:02:50.027664 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:50.027713 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:50.028671 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:50.028953 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:50.028956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:50.029242 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:50.029443 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:50.029447 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.030193 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.030194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:50.031397 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:50.031400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.031928 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.031929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:50.032040 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.032576 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:50.032584 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:50.034019 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:50.035574 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:50.035583 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:50.035585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:50.035894 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:50.036110 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:50.036111 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:50.036112 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:50.036256 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:50.036490 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:50.036498 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:50.036697 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 10:02:50.036864 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 10:02:50.037068 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
I20260811 10:02:50.037957 16369 heartbeater.cc:347] Connected to a master server at 127.9.127.254:42007
I20260811 10:02:50.038062 16369 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:50.038251 16369 heartbeater.cc:511] Master 127.9.127.254:42007 requested a full tablet report, sending...
I20260811 10:02:50.038846 16157 ts_manager.cc:194] Registered new tserver with Master: b45c305ab7f3486192df3e7be14c9ce3 (127.9.127.193:33107)
I20260811 10:02:50.039844 16157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:51365
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:02:50.057772 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42007
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:36799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:50.136927 16376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:50.137136 16376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:50.137176 16376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:50.138312 16376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:50.138374 16376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:50.138418 16376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:50.139845 16376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:36799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:50.140086 16376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:50.140298 16376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:50.145145 16382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:50.145151 16385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:50.145164 16381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:50.145358 16376 server_base.cc:1034] running on GCE node
I20260811 10:02:50.145593 16376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:50.145864 16376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:50.147027 16376 hybrid_clock.cc:648] HybridClock initialized: now 1786442570147016 us; error 43 us; skew 500 ppm
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.154799 16376 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:02:50.155226 16376 webserver.cc:460] Webserver started at http://127.9.127.194:36661/ using document root <none> and password file <none>
I20260811 10:02:50.155452 16376 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:50.155520 16376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:50.155678 16376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:50.156715 16376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "e72aa0f132064b16abd80467001e5f78"
format_stamp: "Formatted at 2026-08-11 10:02:50 on dist-test-slave-1x4g"
server_key: "c4eafaac02976441a3d5b4f2d866fe0e"
server_key_iv: "6b190affccf3d202d986a9aaeb9d4a3a"
server_key_version: "encryptionkey@0"
I20260811 10:02:50.157151 16376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "e72aa0f132064b16abd80467001e5f78"
format_stamp: "Formatted at 2026-08-11 10:02:50 on dist-test-slave-1x4g"
server_key: "c4eafaac02976441a3d5b4f2d866fe0e"
server_key_iv: "6b190affccf3d202d986a9aaeb9d4a3a"
server_key_version: "encryptionkey@0"
I20260811 10:02:50.158459 16376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:50.159178 16392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:50.159346 16376 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:50.159466 16376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "e72aa0f132064b16abd80467001e5f78"
format_stamp: "Formatted at 2026-08-11 10:02:50 on dist-test-slave-1x4g"
server_key: "c4eafaac02976441a3d5b4f2d866fe0e"
server_key_iv: "6b190affccf3d202d986a9aaeb9d4a3a"
server_key_version: "encryptionkey@0"
I20260811 10:02:50.159541 16376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:50.169412 16376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:50.171128 16376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:50.171310 16376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:50.171533 16376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:50.171847 16376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:50.171901 16376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:50.171942 16376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:50.171972 16376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:50.178011 16376 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:37007
I20260811 10:02:50.178063 16516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:37007 every 8 connection(s)
I20260811 10:02:50.178385 16376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:50.182716 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 16376
I20260811 10:02:50.182832 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:50.183032 9727 external_mini_cluster.cc:1428] Setting key eec0d08628bd4e6b89ff9ed8f24cd424
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:50.188597 16200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.179125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:48975 (local address 127.9.127.254:42007)
0811 10:02:50.179179 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.179181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.179434 (+ 253us) server_negotiation.cc:407] Connection header received
0811 10:02:50.180517 (+ 1083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.180519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.180532 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.180585 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.181264 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.181773 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.182793 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.183075 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.183150 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.185673 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:50.185674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:50.185675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:50.185683 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:50.187216 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.187591 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.187593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.187593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.187660 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.187893 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.187894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.187895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.188043 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:50.188119 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:50.188355 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 10:02:50.188460 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:50.188643 16519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.179115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42007 (local address 127.9.127.194:48975)
0811 10:02:50.179299 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:50.179334 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:50.180403 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:50.180660 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:50.180663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:50.180973 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:50.181165 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:50.181170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.181871 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.181873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:50.182703 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:50.182706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.183162 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.183163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:50.183348 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.183868 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:50.183876 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:50.185556 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:50.187298 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:50.187305 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:50.187306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:50.187516 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:50.187734 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:50.187734 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:50.187735 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:50.187830 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:50.188109 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:50.188114 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:50.188227 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 10:02:50.188304 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 10:02:50.188454 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":90,"threads_started":1}
I20260811 10:02:50.189110 16517 heartbeater.cc:347] Connected to a master server at 127.9.127.254:42007
I20260811 10:02:50.189217 16517 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:50.189388 16517 heartbeater.cc:511] Master 127.9.127.254:42007 requested a full tablet report, sending...
I20260811 10:02:50.189800 16157 ts_manager.cc:194] Registered new tserver with Master: e72aa0f132064b16abd80467001e5f78 (127.9.127.194:37007)
I20260811 10:02:50.190168 16157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:48975
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:02:50.209265 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42007
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:36799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:50.288923 16523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:50.289113 16523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:50.289137 16523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:50.290247 16523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:50.290289 16523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:50.290344 16523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:50.291838 16523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:36799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:50.292079 16523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:50.292320 16523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:50.297221 16529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:50.297228 16533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:50.297266 16530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:50.297451 16523 server_base.cc:1034] running on GCE node
I20260811 10:02:50.297636 16523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:50.297863 16523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:50.299003 16523 hybrid_clock.cc:648] HybridClock initialized: now 1786442570298995 us; error 27 us; skew 500 ppm
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.301492 16523 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:02:50.301888 16523 webserver.cc:460] Webserver started at http://127.9.127.195:37687/ using document root <none> and password file <none>
I20260811 10:02:50.302059 16523 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:50.302098 16523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:50.302183 16523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:50.303117 16523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "a6fe1b8f01ed41a9a463279a141aff3b"
format_stamp: "Formatted at 2026-08-11 10:02:50 on dist-test-slave-1x4g"
server_key: "04a38acc2ab6dcf1792ffb5918bbfcf0"
server_key_iv: "83dbfb3ba76a4ef02a95c4e35ffe9f09"
server_key_version: "encryptionkey@0"
I20260811 10:02:50.303408 16523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "a6fe1b8f01ed41a9a463279a141aff3b"
format_stamp: "Formatted at 2026-08-11 10:02:50 on dist-test-slave-1x4g"
server_key: "04a38acc2ab6dcf1792ffb5918bbfcf0"
server_key_iv: "83dbfb3ba76a4ef02a95c4e35ffe9f09"
server_key_version: "encryptionkey@0"
I20260811 10:02:50.304873 16523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:02:50.305594 16540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:50.305763 16523 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:50.305863 16523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "a6fe1b8f01ed41a9a463279a141aff3b"
format_stamp: "Formatted at 2026-08-11 10:02:50 on dist-test-slave-1x4g"
server_key: "04a38acc2ab6dcf1792ffb5918bbfcf0"
server_key_iv: "83dbfb3ba76a4ef02a95c4e35ffe9f09"
server_key_version: "encryptionkey@0"
I20260811 10:02:50.305941 16523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:50.322468 16523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:50.324303 16523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:50.324489 16523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:50.324738 16523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:50.325075 16523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:50.325131 16523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:50.325174 16523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:50.325201 16523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:50.330853 16523 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:44143
I20260811 10:02:50.330905 16664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:44143 every 8 connection(s)
I20260811 10:02:50.331228 16523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:50.333956 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 16523
I20260811 10:02:50.334069 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:50.334252 9727 external_mini_cluster.cc:1428] Setting key 2e89a0e6009cf6db5305d1733291d6da
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:02:50.340842 16200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.331919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:37575 (local address 127.9.127.254:42007)
0811 10:02:50.331965 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.331967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.332157 (+ 190us) server_negotiation.cc:407] Connection header received
0811 10:02:50.333339 (+ 1182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.333341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.333356 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.333401 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.334091 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.334832 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.335925 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.336122 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.336176 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.338215 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:50.338216 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:50.338217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:50.338223 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:50.339698 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.340036 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.340037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.340038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.340088 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.340301 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.340301 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.340302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.340401 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:50.340449 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:50.340666 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 10:02:50.340730 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:02:50.341045 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.331870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42007 (local address 127.9.127.195:37575)
0811 10:02:50.332019 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:50.332066 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:50.333225 (+ 1159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:50.333481 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:50.333485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:50.333746 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:50.333965 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:50.333970 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.334960 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.334961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:50.335852 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:50.335854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.336197 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.336198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:50.336294 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.336726 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:50.336734 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:50.338133 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:50.339765 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:50.339770 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:50.339772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:50.339970 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:50.340141 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:50.340141 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:50.340142 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:50.340249 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:50.340453 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:50.340457 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:50.340560 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 10:02:50.340635 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 10:02:50.340743 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260811 10:02:50.341619 16665 heartbeater.cc:347] Connected to a master server at 127.9.127.254:42007
I20260811 10:02:50.341732 16665 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:50.341902 16665 heartbeater.cc:511] Master 127.9.127.254:42007 requested a full tablet report, sending...
I20260811 10:02:50.342278 16157 ts_manager.cc:194] Registered new tserver with Master: a6fe1b8f01ed41a9a463279a141aff3b (127.9.127.195:44143)
I20260811 10:02:50.342612 16157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:37575
I20260811 10:02:50.345902 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/test-admin.keytab.
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.362576 9727 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 10:02:50.364110 16674 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:50.363338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59940 (local address 127.9.127.193:33107)
0811 10:02:50.363514 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.363518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.363527 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:50.363551 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.363553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.363565 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.363627 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.364031 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59940: BlockingRecv error: recv got EOF from 127.0.0.1:59940 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
W20260811 10:02:50.364194 9727 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5cc' of type FILE
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.365103 9727 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.365916 9727 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:50.373467 16674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.366475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59944 (local address 127.9.127.193:33107)
0811 10:02:50.366526 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.366527 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.366568 (+ 41us) server_negotiation.cc:407] Connection header received
0811 10:02:50.366623 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.366624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.366634 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.366683 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.367033 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.367674 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.368271 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.368539 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.368611 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.370652 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:50.370661 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:50.370661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:50.370667 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:50.372306 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.372669 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.372672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.372672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.372731 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.372949 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.372950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.372951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.373084 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:50.373245 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:50.373298 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 10:02:50.373364 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260811 10:02:50.375161 16674 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:50.374603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59952 (local address 127.9.127.193:33107)
0811 10:02:50.374670 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.374671 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.374682 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:02:50.374747 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.374747 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.374755 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.374814 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.375106 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59952: BlockingRecv error: recv got EOF from 127.0.0.1:59952 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 10:02:50.375228 9727 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5cc' of type FILE
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.376149 9727 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.377048 9727 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:50.383054 16674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.377503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59954 (local address 127.9.127.193:33107)
0811 10:02:50.377565 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.377568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.377576 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:50.377639 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.377640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.377648 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.377691 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.378009 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.378435 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.379034 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.379208 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.379254 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.381077 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:50.381078 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:50.381078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:50.381084 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:50.382232 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.382531 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.382531 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.382531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.382587 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.382734 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.382734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.382734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.382809 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:50.382870 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:50.382945 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 10:02:50.383006 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 10:02:50.384526 16674 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:50.383928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59964 (local address 127.9.127.193:33107)
0811 10:02:50.383992 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.383994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.384088 (+ 94us) server_negotiation.cc:407] Connection header received
0811 10:02:50.384156 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.384157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.384166 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.384216 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.384477 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59964: BlockingRecv error: recv got EOF from 127.0.0.1:59964 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 10:02:50.384590 9727 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786442543469380-9727-0/krb5kdc/krb5cc' of type FILE
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.385408 9727 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:50.386157 9727 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:02:50.392576 16674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:50.386567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59976 (local address 127.9.127.193:33107)
0811 10:02:50.386621 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:50.386622 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:50.386692 (+ 70us) server_negotiation.cc:407] Connection header received
0811 10:02:50.386761 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:50.386762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:50.386771 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:50.386837 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:50.387171 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.387606 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.388231 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:50.388420 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:50.388489 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:50.390369 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:50.390371 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:50.390371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:50.390378 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:50.391517 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.391850 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.391851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.391851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.391909 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:50.392110 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:50.392112 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:50.392112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:50.392206 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:50.392303 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:50.392422 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 10:02:50.392488 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:02:50.393245 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 16226
I20260811 10:02:50.403398 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 16376
I20260811 10:02:50.410256 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 16523
I20260811 10:02:50.416240 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 16124
2026-08-11T10:02:50Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1876 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16687](info): set up 2 sockets
Aug 11 10:02:50 dist-test-slave-1x4g krb5kdc[16687](info): commencing operation
krb5kdc: starting...
W20260811 10:02:51.479959 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:51 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:51Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.254.keytab.
Entry for principal oryx/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.254.keytab.
I20260811 10:02:51.597744 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:38819
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.254.keytab
--principal=oryx/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:38819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:51.675930 16702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:51.676143 16702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:51.676177 16702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:51.677346 16702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:51.677412 16702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:51.677436 16702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:51.677460 16702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:51.677510 16702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:51.678929 16702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:38819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.254.keytab
--principal=oryx/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:38819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:51.679180 16702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:51.679389 16702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:51.684084 16709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:51.684078 16712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:51.684108 16710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:51.684508 16702 server_base.cc:1034] running on GCE node
I20260811 10:02:51.684859 16702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:51.685148 16702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:51.686313 16702 hybrid_clock.cc:648] HybridClock initialized: now 1786442571686298 us; error 26 us; skew 500 ppm
Aug 11 10:02:51 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:51.688812 16702 init.cc:377] Logged in from keytab as oryx/127.9.127.254@KRBTEST.COM (short username oryx)
I20260811 10:02:51.689266 16702 webserver.cc:460] Webserver started at http://127.9.127.254:40699/ using document root <none> and password file <none>
I20260811 10:02:51.689512 16702 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:51.689591 16702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:51.689733 16702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:51.690760 16702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "28671cfc014e42168bd8c2da70aba713"
format_stamp: "Formatted at 2026-08-11 10:02:51 on dist-test-slave-1x4g"
server_key: "15db4876846342d3802e66ae8ea85fa9"
server_key_iv: "dda9b8e2dc832a507a6b8b78b2b4ff6f"
server_key_version: "encryptionkey@0"
I20260811 10:02:51.691119 16702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "28671cfc014e42168bd8c2da70aba713"
format_stamp: "Formatted at 2026-08-11 10:02:51 on dist-test-slave-1x4g"
server_key: "15db4876846342d3802e66ae8ea85fa9"
server_key_iv: "dda9b8e2dc832a507a6b8b78b2b4ff6f"
server_key_version: "encryptionkey@0"
I20260811 10:02:51.692472 16702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:02:51.693274 16719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:51.693439 16702 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:51.693544 16702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "28671cfc014e42168bd8c2da70aba713"
format_stamp: "Formatted at 2026-08-11 10:02:51 on dist-test-slave-1x4g"
server_key: "15db4876846342d3802e66ae8ea85fa9"
server_key_iv: "dda9b8e2dc832a507a6b8b78b2b4ff6f"
server_key_version: "encryptionkey@0"
I20260811 10:02:51.693624 16702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:51.701292 16702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:51.703027 16702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:51.703186 16702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:51.707032 16702 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:38819
I20260811 10:02:51.707093 16778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:38819 every 8 connection(s)
I20260811 10:02:51.707438 16702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:51.708361 16779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:51.710670 16779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: Bootstrap starting.
I20260811 10:02:51.711225 16779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:51.711546 16779 log.cc:824] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:51.712296 16779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: No bootstrap required, opened a new log
I20260811 10:02:51.712276 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 16702
I20260811 10:02:51.712414 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:51.712648 9727 external_mini_cluster.cc:1428] Setting key 3ff1625cae4968f9aa044c84a4827583
I20260811 10:02:51.714170 16779 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } }
I20260811 10:02:51.714354 16779 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:51.714387 16779 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28671cfc014e42168bd8c2da70aba713, State: Initialized, Role: FOLLOWER
I20260811 10:02:51.714553 16779 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } }
I20260811 10:02:51.714658 16779 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:51.714695 16779 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:51.714744 16779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:51.715668 16779 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } }
I20260811 10:02:51.715755 16779 leader_election.cc:302] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28671cfc014e42168bd8c2da70aba713; no voters:
I20260811 10:02:51.715952 16779 leader_election.cc:288] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:51.715972 16784 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:51.716089 16784 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 1 LEADER]: Becoming Leader. State: Replica: 28671cfc014e42168bd8c2da70aba713, State: Running, Role: LEADER
I20260811 10:02:51.716168 16784 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } }
I20260811 10:02:51.716207 16779 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:51.716465 16784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28671cfc014e42168bd8c2da70aba713. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } }
I20260811 10:02:51.716547 16784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:51.716478 16787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } }
I20260811 10:02:51.716704 16787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:51.717027 16791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:51.717634 16791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:51.719373 16791 catalog_manager.cc:1347] Generated new cluster ID: 945b4df57bc34993adac2bde4a73cee9
I20260811 10:02:51.719426 16791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:02:51 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:51.725363 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:51.713163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46850 (local address 127.9.127.254:38819)
0811 10:02:51.713333 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:51.713348 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:51.713370 (+ 22us) server_negotiation.cc:407] Connection header received
0811 10:02:51.714156 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:51.714162 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:51.714204 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:51.714340 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:51.715132 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:51.716174 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:51.717811 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:51.718383 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:51.718793 (+ 410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:51.721296 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:51.721301 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:51.721301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:51.721313 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:51.723272 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:51.723654 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:51.723657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:51.723658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:51.723795 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:51.723991 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:51.723992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:51.723992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:51.724297 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:51.724931 (+ 634us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:51.725004 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 10:02:51.725162 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260811 10:02:51.736840 16791 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:51.737604 16791 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:51.743927 16791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: Generated new TSK 0
I20260811 10:02:51.744102 16791 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab.
Entry for principal oryx/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab.
I20260811 10:02:51.771148 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38819
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab
--principal=oryx/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:51.848688 16810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:51.848893 16810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:51.848917 16810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:51.850015 16810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:51.850055 16810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:51.850080 16810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:51.851476 16810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab
--principal=oryx/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:51.851718 16810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:51.851943 16810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:51.856738 16817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:51.856784 16818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:51.856763 16821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:51.857019 16810 server_base.cc:1034] running on GCE node
I20260811 10:02:51.857262 16810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:51.857530 16810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:51.858671 16810 hybrid_clock.cc:648] HybridClock initialized: now 1786442571858647 us; error 39 us; skew 500 ppm
Aug 11 10:02:51 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:51.861086 16810 init.cc:377] Logged in from keytab as oryx/127.9.127.193@KRBTEST.COM (short username oryx)
I20260811 10:02:51.861541 16810 webserver.cc:460] Webserver started at http://127.9.127.193:34007/ using document root <none> and password file <none>
I20260811 10:02:51.861766 16810 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:51.861835 16810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:51.861968 16810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:51.862982 16810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "d07e5e0a714a40d8913d6deb159e2a85"
format_stamp: "Formatted at 2026-08-11 10:02:51 on dist-test-slave-1x4g"
server_key: "5acc6cc04085b72d6409f7c5c649e35f"
server_key_iv: "0b9c3ec0c0b917e2357a49175b35062f"
server_key_version: "encryptionkey@0"
I20260811 10:02:51.863359 16810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "d07e5e0a714a40d8913d6deb159e2a85"
format_stamp: "Formatted at 2026-08-11 10:02:51 on dist-test-slave-1x4g"
server_key: "5acc6cc04085b72d6409f7c5c649e35f"
server_key_iv: "0b9c3ec0c0b917e2357a49175b35062f"
server_key_version: "encryptionkey@0"
I20260811 10:02:51.864658 16810 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 10:02:51.865422 16828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:51.865696 16810 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:51.865800 16810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "d07e5e0a714a40d8913d6deb159e2a85"
format_stamp: "Formatted at 2026-08-11 10:02:51 on dist-test-slave-1x4g"
server_key: "5acc6cc04085b72d6409f7c5c649e35f"
server_key_iv: "0b9c3ec0c0b917e2357a49175b35062f"
server_key_version: "encryptionkey@0"
I20260811 10:02:51.865872 16810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:51.879830 16810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:51.881873 16810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:51.882033 16810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:51.882252 16810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:51.882558 16810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:51.882613 16810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:51.882647 16810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:51.882673 16810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:51.888600 16810 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:38489
I20260811 10:02:51.888640 16951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:38489 every 8 connection(s)
I20260811 10:02:51.888993 16810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
Aug 11 10:02:51 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:51.895961 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 16810
I20260811 10:02:51.896104 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:51.896313 9727 external_mini_cluster.cc:1428] Setting key 70e646ea6aaf9d074e23ddefec63c975
I20260811 10:02:51.898047 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:51.889714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:58365 (local address 127.9.127.254:38819)
0811 10:02:51.889793 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:51.889795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:51.889970 (+ 175us) server_negotiation.cc:407] Connection header received
0811 10:02:51.890495 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:51.890496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:51.890508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:51.890554 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:51.891433 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:51.891942 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:51.892984 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:51.893207 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:51.893290 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:51.895140 (+ 1850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:51.895142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:51.895142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:51.895150 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:51.896557 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:51.897069 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:51.897071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:51.897071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:51.897136 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:51.897384 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:51.897385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:51.897385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:51.897505 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:51.897576 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:51.897862 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 10:02:51.897949 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 10:02:51.898175 16955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:51.889678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.193:58365)
0811 10:02:51.889859 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:51.889896 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:51.890384 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:51.890617 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:51.890620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:51.891145 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:51.891334 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:51.891339 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:51.892046 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:51.892048 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:51.892892 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:51.892895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:51.893304 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:51.893305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:51.893423 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:51.893800 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:51.893807 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:51.895048 (+ 1241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:51.896654 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:51.896662 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:51.896664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:51.896969 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:51.897203 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:51.897204 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:51.897204 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:51.897315 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:51.897580 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:51.897588 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:51.897716 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 10:02:51.897826 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 10:02:51.897968 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260811 10:02:51.898589 16952 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38819
I20260811 10:02:51.898679 16952 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:51.898831 16952 heartbeater.cc:511] Master 127.9.127.254:38819 requested a full tablet report, sending...
I20260811 10:02:51.899281 16739 ts_manager.cc:194] Registered new tserver with Master: d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489)
I20260811 10:02:51.899900 16739 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:58365
WARNING: no policy specified for oryx/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab.
Entry for principal oryx/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab.
I20260811 10:02:51.923254 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38819
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab
--principal=oryx/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:52.001916 16958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:52.002107 16958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:52.002130 16958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:52.003183 16958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:52.003217 16958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:52.003243 16958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:52.004576 16958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab
--principal=oryx/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:52.004746 16958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:52.004981 16958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:52.009590 16963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.009596 16966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.009598 16964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:52.009887 16958 server_base.cc:1034] running on GCE node
I20260811 10:02:52.010118 16958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:52.010349 16958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:52.011510 16958 hybrid_clock.cc:648] HybridClock initialized: now 1786442572011502 us; error 32 us; skew 500 ppm
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:52.014010 16958 init.cc:377] Logged in from keytab as oryx/127.9.127.194@KRBTEST.COM (short username oryx)
I20260811 10:02:52.014472 16958 webserver.cc:460] Webserver started at http://127.9.127.194:35019/ using document root <none> and password file <none>
I20260811 10:02:52.014698 16958 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.014758 16958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.014884 16958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:52.015815 16958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "2e7757f92d594855ab67edbe5e7a14fa"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "6bdb524bfe278082343fc8d8c9388603"
server_key_iv: "b8993a6f9635e4bda0f55ac17f4f74cf"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.016184 16958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "2e7757f92d594855ab67edbe5e7a14fa"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "6bdb524bfe278082343fc8d8c9388603"
server_key_iv: "b8993a6f9635e4bda0f55ac17f4f74cf"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.017722 16958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:02:52.018539 16974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.018723 16958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.018818 16958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "2e7757f92d594855ab67edbe5e7a14fa"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "6bdb524bfe278082343fc8d8c9388603"
server_key_iv: "b8993a6f9635e4bda0f55ac17f4f74cf"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.018903 16958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.028477 16958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:52.030308 16958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:52.030468 16958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:52.030689 16958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:52.030987 16958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:52.031054 16958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.031086 16958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:52.031112 16958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.037102 16958 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:41101
I20260811 10:02:52.037151 17098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:41101 every 8 connection(s)
I20260811 10:02:52.037474 16958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:52.037998 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 16958
I20260811 10:02:52.038125 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:52.038338 9727 external_mini_cluster.cc:1428] Setting key 41f17861d40daaa81e15e2f2e312ac29
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:52.046690 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.038174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:43953 (local address 127.9.127.254:38819)
0811 10:02:52.038221 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.038223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.038448 (+ 225us) server_negotiation.cc:407] Connection header received
0811 10:02:52.039059 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.039060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.039073 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.039125 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.040002 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.040493 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.041574 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.041789 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.041878 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.043917 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.043919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.043920 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.043927 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.045318 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.045725 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.045727 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.045727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.045796 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.046058 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.046058 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.046059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.046169 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.046244 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.046517 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.046604 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for oryx/127.9.127.195@KRBTEST.COM; defaulting to no policy
I20260811 10:02:52.046849 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.038162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.194:43953)
0811 10:02:52.038320 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.038354 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.038936 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.039188 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.039192 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.039726 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.039896 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.039900 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.040590 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.040592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.041478 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.041481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.041890 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.041891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.042036 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.042523 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.042530 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.043822 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.045415 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.045422 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.045424 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.045646 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.045864 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.045865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.045866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.045980 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.046236 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.046243 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.046376 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.046484 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.046630 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":97,"threads_started":1}
I20260811 10:02:52.047307 17099 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38819
I20260811 10:02:52.047402 17099 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:52.047593 17099 heartbeater.cc:511] Master 127.9.127.254:38819 requested a full tablet report, sending...
I20260811 10:02:52.048022 16739 ts_manager.cc:194] Registered new tserver with Master: 2e7757f92d594855ab67edbe5e7a14fa (127.9.127.194:41101)
I20260811 10:02:52.048398 16739 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:43953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab.
Entry for principal oryx/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab.
I20260811 10:02:52.064345 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38819
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab
--principal=oryx/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:52.142508 17104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:52.142725 17104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:52.142762 17104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:52.143929 17104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:52.144001 17104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:52.144042 17104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:52.145579 17104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab
--principal=oryx/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:52.145836 17104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:52.146060 17104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:52.150866 17111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.150887 17112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.150879 17114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:52.151135 17104 server_base.cc:1034] running on GCE node
I20260811 10:02:52.151346 17104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:52.151620 17104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:52.152825 17104 hybrid_clock.cc:648] HybridClock initialized: now 1786442572152808 us; error 27 us; skew 500 ppm
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:52.155224 17104 init.cc:377] Logged in from keytab as oryx/127.9.127.195@KRBTEST.COM (short username oryx)
I20260811 10:02:52.155659 17104 webserver.cc:460] Webserver started at http://127.9.127.195:34373/ using document root <none> and password file <none>
I20260811 10:02:52.155887 17104 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.155951 17104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.156105 17104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:52.157193 17104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "db968ae00ef74e139f64b4c33529b824"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "b1e5b67914243bfd92038cf5fb3951ab"
server_key_iv: "3a79bf24926891a0a170dc4661698f66"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.157565 17104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "db968ae00ef74e139f64b4c33529b824"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "b1e5b67914243bfd92038cf5fb3951ab"
server_key_iv: "3a79bf24926891a0a170dc4661698f66"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.158856 17104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:52.159560 17123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.159729 17104 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:52.159833 17104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "db968ae00ef74e139f64b4c33529b824"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "b1e5b67914243bfd92038cf5fb3951ab"
server_key_iv: "3a79bf24926891a0a170dc4661698f66"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.159905 17104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.187526 17104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:52.189335 17104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:52.189494 17104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:52.189718 17104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:52.190030 17104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:52.190091 17104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.190127 17104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:52.190153 17104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.195801 17104 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:43845
I20260811 10:02:52.195899 17243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:43845 every 8 connection(s)
I20260811 10:02:52.196200 17104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:52.199085 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 17104
I20260811 10:02:52.199204 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:52.199396 9727 external_mini_cluster.cc:1428] Setting key 9bcf9c533e0e11d7b829a6dfd1137b81
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:52.205201 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.197045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:57449 (local address 127.9.127.254:38819)
0811 10:02:52.197089 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.197091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.197271 (+ 180us) server_negotiation.cc:407] Connection header received
0811 10:02:52.197729 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.197730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.197740 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.197794 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.198695 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.199214 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.200510 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.200697 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.200752 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.202887 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.202888 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.202888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.202894 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.203997 (+ 1103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.204366 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.204367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.204367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.204417 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.204635 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.204636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.204636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.204729 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.204835 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.205067 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.205140 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:52.205351 17247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.196983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.195:57449)
0811 10:02:52.197148 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.197189 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.197648 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.197855 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.197858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.198389 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.198587 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.198592 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.199331 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.199332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.200437 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.200440 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.200808 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.200809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.200936 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.201476 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.201484 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.202812 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.204068 (+ 1256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.204076 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.204078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.204299 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.204475 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.204476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.204476 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.204580 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.204826 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.204831 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.204937 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.205038 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.205151 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":101,"threads_started":1}
I20260811 10:02:52.205837 17245 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38819
I20260811 10:02:52.205940 17245 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:52.206132 17245 heartbeater.cc:511] Master 127.9.127.254:38819 requested a full tablet report, sending...
I20260811 10:02:52.206561 16739 ts_manager.cc:194] Registered new tserver with Master: db968ae00ef74e139f64b4c33529b824 (127.9.127.195:43845)
I20260811 10:02:52.206947 16739 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:57449
I20260811 10:02:52.211004 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.127.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.253.keytab.
Entry for principal oryx/127.9.127.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.253.keytab.
I20260811 10:02:52.237653 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.253:38101
--webserver_interface=127.9.127.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.253.keytab
--principal=oryx/127.9.127.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:38819,127.9.127.253:38101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:52.314976 17250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:52.315178 17250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:52.315198 17250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:52.316284 17250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:52.316323 17250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:52.316337 17250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:52.316349 17250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:52.316361 17250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:52.317945 17250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:38819,127.9.127.253:38101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.253.keytab
--principal=oryx/127.9.127.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.253:38101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.127.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
W20260811 10:02:52.318059 17250 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.9.127.254:38819,127.9.127.253:38101'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 10:02:52.318169 17250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:52.318342 17250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:52.322762 17259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.322757 17256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.322757 17257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:52.322995 17250 server_base.cc:1034] running on GCE node
I20260811 10:02:52.323266 17250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:52.323547 17250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:52.324708 17250 hybrid_clock.cc:648] HybridClock initialized: now 1786442572324696 us; error 40 us; skew 500 ppm
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:52.327279 17250 init.cc:377] Logged in from keytab as oryx/127.9.127.253@KRBTEST.COM (short username oryx)
I20260811 10:02:52.327628 17250 webserver.cc:460] Webserver started at http://127.9.127.253:39409/ using document root <none> and password file <none>
I20260811 10:02:52.327800 17250 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.327852 17250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.327963 17250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:52.328965 17250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data/instance:
uuid: "fcc14517fe694ca0af77c3a9e8aff60a"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "423bfdc0663a012d660a958313b1ea63"
server_key_iv: "2c1af28fb0aff8b8224b7a60542dc633"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.329253 17250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal/instance:
uuid: "fcc14517fe694ca0af77c3a9e8aff60a"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "423bfdc0663a012d660a958313b1ea63"
server_key_iv: "2c1af28fb0aff8b8224b7a60542dc633"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.330449 17250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:52.331120 17266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.331297 17250 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:52.331380 17250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
uuid: "fcc14517fe694ca0af77c3a9e8aff60a"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "423bfdc0663a012d660a958313b1ea63"
server_key_iv: "2c1af28fb0aff8b8224b7a60542dc633"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.331432 17250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.347572 17250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:52.349218 17250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:52.349314 17250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:52.353088 17250 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.253:38101
I20260811 10:02:52.353123 17322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.253:38101 every 8 connection(s)
I20260811 10:02:52.353449 17250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
I20260811 10:02:52.354463 17323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:52.355865 17323 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.253@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:52.362560 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 17250
I20260811 10:02:52.364812 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.356559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46858 (local address 127.9.127.254:38819)
0811 10:02:52.356663 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.356665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.356861 (+ 196us) server_negotiation.cc:407] Connection header received
0811 10:02:52.357327 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.357328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.357338 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.357389 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.357960 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.358426 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.359387 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.359556 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.359606 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.361758 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.361759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.361759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.361765 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.363198 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.363747 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.363748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.363748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.363810 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.364073 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.364082 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.364082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.364255 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.364345 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.364617 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.364697 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 10:02:52.364984 17325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.356493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:46858)
0811 10:02:52.356674 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.356724 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.357237 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.357445 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.357448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.357681 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.357878 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.357882 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.358506 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.358507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.359312 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.359315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.359631 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.359631 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.359732 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.360242 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.360250 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.361674 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.363290 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.363297 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.363299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.363644 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.363889 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.363890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.363890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.363998 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.364325 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.364344 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.364479 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.364594 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.364744 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260811 10:02:52.365686 17323 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.127.253@KRBTEST.COM
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.253@KRBTEST.COM for oryx/127.9.127.253@KRBTEST.COM
I20260811 10:02:52.372699 17328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.363205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40228 (local address 127.9.127.253:38101)
0811 10:02:52.363608 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.363613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.363631 (+ 18us) server_negotiation.cc:407] Connection header received
0811 10:02:52.363653 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.363655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.363669 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.363800 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.364461 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.365412 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.366430 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.366821 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.366900 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.369579 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.369587 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.369587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.369594 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.371299 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.371766 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.371768 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.371768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.371822 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.372064 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.372065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.372065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.372193 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.372310 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.372500 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.372585 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":87,"threads_started":1}
I20260811 10:02:52.374573 17325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.365954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.0.0.1:40232)
0811 10:02:52.366003 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.366014 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.366067 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.366283 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.366283 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.366437 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.366489 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.366493 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.367340 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.367340 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.368221 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.368224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.368824 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.368825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.368897 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.369268 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.369273 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.370757 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.373484 (+ 2727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.373484 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.373485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.373653 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.373882 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.373883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.373884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.373942 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.374235 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.374235 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.374273 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.374349 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.374456 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 10:02:52.374668 17329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.365987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40232 (local address 127.9.127.253:38101)
0811 10:02:52.366143 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.366145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.366152 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:52.366171 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.366172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.366186 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.366266 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.366578 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.367246 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.368381 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.368691 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.368767 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.370869 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.370871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.370871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.370878 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.373381 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.373739 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.373740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.373741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.373802 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.374026 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.374027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.374027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.374162 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.374245 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.374375 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.374510 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":131,"thread_start_us":107,"threads_started":1}
I20260811 10:02:52.375828 17323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Bootstrap starting.
I20260811 10:02:52.376397 17323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:52.376621 17323 log.cc:824] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:52.377462 17323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: No bootstrap required, opened a new log
I20260811 10:02:52.378773 17323 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } }
I20260811 10:02:52.378891 17323 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:52.378921 17323 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcc14517fe694ca0af77c3a9e8aff60a, State: Initialized, Role: FOLLOWER
I20260811 10:02:52.379012 17323 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } }
I20260811 10:02:52.379256 17323 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:52.379230 17331 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } } }
I20260811 10:02:52.379328 17331 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: This master's current role is: FOLLOWER
W20260811 10:02:52.381055 17343 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:02:52.381130 17343 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:02:52.382709 17250 master_runner.cc:428] Detected that this master fcc14517fe694ca0af77c3a9e8aff60a is joining an existing cluster
I20260811 10:02:52.382750 17250 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.127.253:38101
I20260811 10:02:52.390426 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.383740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46868 (local address 127.9.127.254:38819)
0811 10:02:52.383777 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.383779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.383909 (+ 130us) server_negotiation.cc:407] Connection header received
0811 10:02:52.383983 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.383984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.383994 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.384049 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.384540 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.385137 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.386168 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.386405 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.386435 (+ 30us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.387552 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.387554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.387554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.387560 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.389135 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.389557 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.389558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.389558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.389622 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.389858 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.389859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.389860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.389984 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.390028 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.390253 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.390321 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:02:52.390446 17350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.383675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:46868)
0811 10:02:52.383836 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.383846 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.383924 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.384097 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.384098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.384345 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.384439 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.384442 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.385216 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.385216 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.386071 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.386073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.386494 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.386495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.386548 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.387008 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.387012 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.387454 (+ 442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.389233 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.389234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.389235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.389489 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.389710 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.389711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.389712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.389769 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.390077 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.390078 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.390119 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.390225 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.390320 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260811 10:02:52.391578 17329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.384071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40248 (local address 127.9.127.253:38101)
0811 10:02:52.384105 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.384106 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.384117 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:02:52.384155 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.384156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.384165 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.384226 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.384615 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.385321 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.386261 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.386548 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.386629 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.387641 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.387642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.387642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.387649 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.389749 (+ 2100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.390108 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.390109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.390109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.390175 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.390382 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.390383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.390383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.391130 (+ 747us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.391185 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.391415 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.391496 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:02:52.392057 17351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.383932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.0.0.1:40248)
0811 10:02:52.384041 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.384050 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.384096 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.384238 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.384238 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.384453 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.384529 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.384531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.385411 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.385411 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.386179 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.386181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.386638 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.386639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.386703 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.387198 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.387203 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.387556 (+ 353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.389831 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.389832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.389833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.390027 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.390259 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.390260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.390260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.390315 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.391235 (+ 920us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.391236 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.391273 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.391846 (+ 573us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.391955 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":70,"threads_started":1}
I20260811 10:02:52.394356 17331 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:52.394449 17331 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } }
I20260811 10:02:52.394634 17331 leader_election.cc:288] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28671cfc014e42168bd8c2da70aba713 (127.9.127.254:38819)
I20260811 10:02:52.394956 16751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28671cfc014e42168bd8c2da70aba713" is_pre_election: true
I20260811 10:02:52.395318 17267 leader_election.cc:302] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: fcc14517fe694ca0af77c3a9e8aff60a; no voters: 28671cfc014e42168bd8c2da70aba713
I20260811 10:02:52.395470 17331 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.254@KRBTEST.COM for oryx/127.9.127.253@KRBTEST.COM
I20260811 10:02:52.400708 17329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.393214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40260 (local address 127.9.127.253:38101)
0811 10:02:52.393252 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.393254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.393441 (+ 187us) server_negotiation.cc:407] Connection header received
0811 10:02:52.393532 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.393533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.393540 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.393589 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.394071 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.394609 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.395645 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.395894 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.395972 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.398197 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.398198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.398198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.398205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.399568 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.399950 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.399951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.399951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.400013 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.400210 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.400211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.400212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.400313 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.400378 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.400570 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.400639 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:02:52.400751 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.393165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.0.0.1:40260)
0811 10:02:52.393321 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.393366 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.393449 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.393596 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.393599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.393931 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.393989 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.393991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.394688 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.394689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.395578 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.395582 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.395978 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.395979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.396058 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.396585 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.396590 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.398109 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.399668 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.399676 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.399678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.399872 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.400078 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.400079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.400079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.400138 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.400384 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.400392 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.400439 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.400531 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.400657 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":67,"threads_started":1}
I20260811 10:02:52.401285 16739 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.127.253:38101: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a"
member_type: NON_VOTER
last_known_addr {
host: "127.9.127.253"
port: 38101
}
attrs {
promote: true
}
}
dest_uuid: "28671cfc014e42168bd8c2da70aba713"
cas_config_opid_index: -1
I20260811 10:02:52.401640 16739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } }
I20260811 10:02:52.402215 17353 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER fcc14517fe694ca0af77c3a9e8aff60a (127.9.127.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } }
I20260811 10:02:52.402501 17294 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:52.403213 17294 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Refusing update from remote peer 28671cfc014e42168bd8c2da70aba713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 10:02:52.403378 17353 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.127.253:38101
I20260811 10:02:52.403539 17355 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:52.403578 17354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } }
I20260811 10:02:52.403772 17250 master.cc:537] Master@127.9.127.253:38101 shutting down...
W20260811 10:02:52.404341 16720 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260811 10:02:52.403802 17354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
W20260811 10:02:52.406504 16720 consensus_peers.cc:487] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 -> Peer fcc14517fe694ca0af77c3a9e8aff60a (127.9.127.253:38101): Couldn't send request to peer fcc14517fe694ca0af77c3a9e8aff60a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 10:02:52.406859 17250 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:52.406955 17250 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:52.407002 17250 tablet_replica.cc:330] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: stopping tablet replica
I20260811 10:02:52.410060 17250 master.cc:552] Master@127.9.127.253:38101 shutdown complete.
I20260811 10:02:52.410110 17250 master_runner.cc:305] Clearing existing system tablet
I20260811 10:02:52.410246 17250 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.410296 17250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.411001 17250 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.002s
I20260811 10:02:52.411526 17361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.411720 17250 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.411784 17250 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:52.411813 17250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
uuid: "fcc14517fe694ca0af77c3a9e8aff60a"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "423bfdc0663a012d660a958313b1ea63"
server_key_iv: "2c1af28fb0aff8b8224b7a60542dc633"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.412587 17250 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:52.414083 17250 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 10:02:52.414156 17250 log.cc:1196] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 10:02:52.414379 17250 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Deleting consensus metadata
I20260811 10:02:52.414510 17250 master_runner.cc:315] Copying system tablet from 127.9.127.254:38819
I20260811 10:02:52.415169 17250 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.127.254:38819
I20260811 10:02:52.421420 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.415528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46874 (local address 127.9.127.254:38819)
0811 10:02:52.415575 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.415577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.415638 (+ 61us) server_negotiation.cc:407] Connection header received
0811 10:02:52.415684 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.415685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.415695 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.415770 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.416081 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.416803 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.417638 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.417958 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.418060 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.418842 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.418843 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.418843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.418849 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.420155 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.420540 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.420541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.420542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.420605 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.420866 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.420867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.420867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.421002 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.421067 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.421260 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.421333 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 10:02:52.421718 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.415463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:46874)
0811 10:02:52.415567 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.415590 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.415644 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.415772 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.415772 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.415945 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.415989 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.415991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.416887 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.416888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.417547 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.417549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.418065 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.418066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.418114 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.418497 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.418501 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.418764 (+ 263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.420259 (+ 1495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.420260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.420260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.420438 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.420683 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.420683 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.420683 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.420732 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.421096 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.421097 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.421141 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.421528 (+ 387us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.421630 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":70,"threads_started":1}
I20260811 10:02:52.422268 16762 tablet_copy_service.cc:140] P 28671cfc014e42168bd8c2da70aba713: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer fcc14517fe694ca0af77c3a9e8aff60a ({username='oryx', principal='oryx/127.9.127.253@KRBTEST.COM'} at 127.0.0.1:46874)
I20260811 10:02:52.422376 16762 tablet_copy_service.cc:161] P 28671cfc014e42168bd8c2da70aba713: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer fcc14517fe694ca0af77c3a9e8aff60a at {username='oryx', principal='oryx/127.9.127.253@KRBTEST.COM'} at 127.0.0.1:46874: session id = fcc14517fe694ca0af77c3a9e8aff60a-00000000000000000000000000000000
I20260811 10:02:52.423133 16762 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 10:02:52.423708 17250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 10:02:52.424489 17250 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: tablet copy: Starting download of 0 data blocks...
I20260811 10:02:52.424628 17250 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: tablet copy: Starting download of 1 WAL segments...
I20260811 10:02:52.425520 17250 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 10:02:52.426249 16762 tablet_copy_service.cc:342] P 28671cfc014e42168bd8c2da70aba713: Request end of tablet copy session fcc14517fe694ca0af77c3a9e8aff60a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.127.253@KRBTEST.COM'} at 127.0.0.1:46874
I20260811 10:02:52.426304 16762 tablet_copy_service.cc:433] P 28671cfc014e42168bd8c2da70aba713: ending tablet copy session fcc14517fe694ca0af77c3a9e8aff60a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer fcc14517fe694ca0af77c3a9e8aff60a
I20260811 10:02:52.428629 17250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 10:02:52.429692 17250 server_base.cc:1034] running on GCE node
W20260811 10:02:52.429656 17369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.429781 17371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.429984 17368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:52.430126 17250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:52.430279 17250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:52.431398 17250 hybrid_clock.cc:648] HybridClock initialized: now 1786442572431392 us; error 23 us; skew 500 ppm
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:52.432610 17250 init.cc:377] Logged in from keytab as oryx/127.9.127.253@KRBTEST.COM (short username oryx)
I20260811 10:02:52.432909 17250 webserver.cc:460] Webserver started at http://127.9.127.253:42801/ using document root <none> and password file <none>
I20260811 10:02:52.433043 17250 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.433077 17250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.433650 17250 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:52.434152 17378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.434281 17250 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.434324 17250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
uuid: "fcc14517fe694ca0af77c3a9e8aff60a"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "423bfdc0663a012d660a958313b1ea63"
server_key_iv: "2c1af28fb0aff8b8224b7a60542dc633"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.434370 17250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.456934 17250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:52.458546 17250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:52.463039 17250 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.253:38101
I20260811 10:02:52.463088 17434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.253:38101 every 8 connection(s)
I20260811 10:02:52.463374 17250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
I20260811 10:02:52.464336 17435 sys_catalog.cc:263] Verifying existing consensus state
I20260811 10:02:52.464902 17435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Bootstrap starting.
I20260811 10:02:52.467900 17435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:02:52.468163 17435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Bootstrap complete.
I20260811 10:02:52.468387 17435 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } }
I20260811 10:02:52.468473 17435 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fcc14517fe694ca0af77c3a9e8aff60a, State: Initialized, Role: LEARNER
I20260811 10:02:52.468515 17435 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } }
I20260811 10:02:52.468678 17435 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:52.468688 17438 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } }
I20260811 10:02:52.468832 17438 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: This master's current role is: LEARNER
I20260811 10:02:52.470194 17452 catalog_manager.cc:1259] Loaded cluster ID: 945b4df57bc34993adac2bde4a73cee9
I20260811 10:02:52.470256 17452 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: loading cluster ID for follower catalog manager: success
I20260811 10:02:52.471410 17452 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: acquiring CA information for follower catalog manager: success
I20260811 10:02:52.471683 17452 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 10:02:52.480491 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.474176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40292 (local address 127.9.127.253:38101)
0811 10:02:52.474288 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.474290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.474299 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:52.474322 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.474322 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.474332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.474409 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.474868 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.475775 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.476424 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.476716 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.476828 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.477963 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.477964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.477964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.477971 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.479340 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.479697 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.479698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.479699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.479764 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.479979 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.479980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.479980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.480111 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.480225 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.480302 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.480379 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":51,"threads_started":1}
WARNING: no policy specified for oryx/127.9.127.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.252.keytab.
Entry for principal oryx/127.9.127.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.252.keytab.
I20260811 10:02:52.505566 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.252:44761
--webserver_interface=127.9.127.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.252.keytab
--principal=oryx/127.9.127.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:38819,127.9.127.253:38101,127.9.127.252:44761
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:52.587621 17456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:52.587838 17456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:52.587875 17456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:52.589056 17456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:52.589112 17456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:52.589133 17456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:52.589160 17456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:52.589188 17456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:52.590549 17456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:38819,127.9.127.253:38101,127.9.127.252:44761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.252.keytab
--principal=oryx/127.9.127.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.252:44761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.127.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:52.590797 17456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:52.590999 17456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:52.595584 17461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.595530 17464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.595546 17462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:52.595790 17456 server_base.cc:1034] running on GCE node
I20260811 10:02:52.596019 17456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:52.596372 17456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:52.597514 17456 hybrid_clock.cc:648] HybridClock initialized: now 1786442572597494 us; error 34 us; skew 500 ppm
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:52.599841 17456 init.cc:377] Logged in from keytab as oryx/127.9.127.252@KRBTEST.COM (short username oryx)
I20260811 10:02:52.600379 17456 webserver.cc:460] Webserver started at http://127.9.127.252:46431/ using document root <none> and password file <none>
I20260811 10:02:52.600612 17456 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.600656 17456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.600843 17456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:52.601886 17456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data/instance:
uuid: "b6434f7a92a24ac6ae905eb33d1b3815"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "382a32430da4979d2369743625596bdf"
server_key_iv: "dc7ced31a86f71c87ef0f7794414be59"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.602226 17456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal/instance:
uuid: "b6434f7a92a24ac6ae905eb33d1b3815"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "382a32430da4979d2369743625596bdf"
server_key_iv: "dc7ced31a86f71c87ef0f7794414be59"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.603693 17456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:52.604427 17473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.604592 17456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:52.604687 17456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
uuid: "b6434f7a92a24ac6ae905eb33d1b3815"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "382a32430da4979d2369743625596bdf"
server_key_iv: "dc7ced31a86f71c87ef0f7794414be59"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.604764 17456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.613457 17456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:52.615044 17456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:52.615190 17456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:52.620221 17456 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.252:44761
I20260811 10:02:52.620271 17530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.252:44761 every 8 connection(s)
I20260811 10:02:52.620599 17456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
I20260811 10:02:52.621724 17531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:52.623225 17531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.252@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:52.630676 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 17456
I20260811 10:02:52.632071 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.624085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46882 (local address 127.9.127.254:38819)
0811 10:02:52.624158 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.624160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.624283 (+ 123us) server_negotiation.cc:407] Connection header received
0811 10:02:52.624749 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.624750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.624763 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.624845 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.625404 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.625912 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.626841 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.627035 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.627113 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.629188 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.629189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.629190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.629197 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.630595 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.631020 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.631021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.631021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.631076 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.631397 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.631397 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.631398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.631502 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.631620 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.631895 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.631982 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 10:02:52.632233 17533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.623883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:46882)
0811 10:02:52.624148 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.624191 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.624641 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.624914 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.624918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.625142 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.625309 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.625313 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.626003 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.626004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.626749 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.626752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.627141 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.627143 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.627252 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.627742 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.627750 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.629093 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.630683 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.630689 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.630690 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.630937 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.631168 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.631169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.631170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.631316 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.631615 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.631621 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.631756 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.631856 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.632005 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":154,"threads_started":1}
I20260811 10:02:52.632752 17531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.127.252@KRBTEST.COM
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.252@KRBTEST.COM for oryx/127.9.127.253@KRBTEST.COM
I20260811 10:02:52.639343 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.631189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59728 (local address 127.9.127.252:44761)
0811 10:02:52.631354 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.631358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.631376 (+ 18us) server_negotiation.cc:407] Connection header received
0811 10:02:52.631398 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.631400 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.631418 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.631510 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.632060 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.633033 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.633742 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.634009 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.634080 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.636442 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.636449 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.636449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.636457 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.638102 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.638454 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.638456 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.638457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.638520 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.638738 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.638738 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.638739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.638920 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.639079 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.639166 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.639244 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260811 10:02:52.639564 17533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.633009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.0.0.1:40294)
0811 10:02:52.633058 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.633069 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.633108 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.633248 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.633248 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.633380 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.633419 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.633420 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.634058 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.634059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.634780 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.634782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.635184 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.635185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.635246 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.635605 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.635610 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.636765 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.638523 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.638523 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.638524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.638739 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.638920 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.638920 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.638921 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.638984 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.639256 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.639256 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.639294 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.639395 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.639477 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 10:02:52.639810 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.633105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40294 (local address 127.9.127.253:38101)
0811 10:02:52.633151 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.633154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.633163 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:52.633188 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.633189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.633200 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.633248 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.633499 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.633955 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.634873 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.635102 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.635182 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.636887 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.636888 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.636889 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.636896 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.638459 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.638810 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.638811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.638811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.638858 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.639060 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.639060 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.639061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.639186 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.639252 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.639627 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.639727 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 10:02:52.640163 17531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.252@KRBTEST.COM for oryx/127.9.127.252@KRBTEST.COM
I20260811 10:02:52.645597 17533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.640368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.0.0.1:59734)
0811 10:02:52.640410 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.640419 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.640452 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.640552 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.640553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.640673 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.640693 (+ 20us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.640694 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.641278 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.641279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.641744 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.641745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.642100 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.642101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.642148 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.642521 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.642525 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.643583 (+ 1058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.644903 (+ 1320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.644904 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.644904 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.645045 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.645198 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.645199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.645199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.645244 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.645415 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.645416 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.645449 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.645490 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.645551 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 10:02:52.645709 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.640440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59734 (local address 127.9.127.252:44761)
0811 10:02:52.640470 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.640472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.640479 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:52.640495 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.640496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.640504 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.640547 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.640768 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.641205 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.641821 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.642027 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.642102 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.643654 (+ 1552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.643655 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.643655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.643661 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.644756 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.645101 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.645102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.645102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.645146 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.645290 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.645290 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.645290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.645369 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.645411 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.645509 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.645593 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":17}
I20260811 10:02:52.646720 17531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Bootstrap starting.
I20260811 10:02:52.647564 17531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:52.648126 17531 log.cc:824] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:52.648864 17531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: No bootstrap required, opened a new log
I20260811 10:02:52.650609 17531 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } }
I20260811 10:02:52.650712 17531 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:52.650760 17531 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6434f7a92a24ac6ae905eb33d1b3815, State: Initialized, Role: FOLLOWER
I20260811 10:02:52.650879 17531 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } }
I20260811 10:02:52.651144 17531 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:52.651124 17537 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } } }
I20260811 10:02:52.651223 17537 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 10:02:52.653491 17549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:02:52.653554 17549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:02:52.655660 17456 master_runner.cc:428] Detected that this master b6434f7a92a24ac6ae905eb33d1b3815 is joining an existing cluster
I20260811 10:02:52.655697 17456 master_runner.cc:432] Initiating AddMaster RPC to add 127.9.127.252:44761
I20260811 10:02:52.663916 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.657032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40306 (local address 127.9.127.253:38101)
0811 10:02:52.657097 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.657099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.657217 (+ 118us) server_negotiation.cc:407] Connection header received
0811 10:02:52.657341 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.657342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.657353 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.657383 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.657844 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.658292 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.659652 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.659967 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.660070 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.660993 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.660994 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.660995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.661001 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.662667 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.663135 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.663136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.663136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.663185 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.663431 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.663432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.663432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.663536 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.663579 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.663760 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.663831 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 10:02:52.663998 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.656990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.0.0.1:40306)
0811 10:02:52.657159 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.657169 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.657240 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.657445 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.657446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.657679 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.657754 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.657755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.658371 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.658372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.659404 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.659406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.660071 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.660072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.660137 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.660546 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.660550 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.660908 (+ 358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.662747 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.662748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.662749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.663059 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.663263 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.663264 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.663264 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.663356 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.663617 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.663617 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.663664 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.663735 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.663831 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":2,"thread_start_us":123,"threads_started":1}
I20260811 10:02:52.668855 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.657470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.9.127.252:44761)
0811 10:02:52.657505 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.657507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.661010 (+ 3503us) server_negotiation.cc:407] Connection header received
0811 10:02:52.661090 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.661091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.661101 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.661156 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.662076 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.662804 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.664924 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.665089 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.665135 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.666192 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.666193 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.666193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.666199 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.667487 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.667929 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.667930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.667930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.667976 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.668236 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.668236 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.668237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.668335 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.668379 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.668603 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.668725 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":18}
I20260811 10:02:52.668848 17557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.657276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.0.0.1:59748)
0811 10:02:52.660948 (+ 3672us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.660959 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.661032 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.661159 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.661160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.661773 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.661962 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.661965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.663152 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.663153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.664851 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.664854 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.665158 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.665159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.665242 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.665682 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.665687 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.666117 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.667570 (+ 1453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.667572 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.667572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.667864 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.668043 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.668044 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.668044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.668174 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.668396 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.668396 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.668439 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.668563 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.668665 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3616,"thread_start_us":115,"threads_started":1}
I20260811 10:02:52.684765 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.656670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46894 (local address 127.9.127.254:38819)
0811 10:02:52.656731 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.656733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.656938 (+ 205us) server_negotiation.cc:407] Connection header received
0811 10:02:52.657033 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.657033 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.657044 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.657075 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.657768 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.658527 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.659825 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.660075 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.660133 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.682114 (+ 21981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.682115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.682115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.682158 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.683666 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.684001 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.684002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.684002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.684058 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.684254 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.684254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.684255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.684368 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.684441 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.684587 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.684659 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:02:52.684867 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.656609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:46894)
0811 10:02:52.656871 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.656880 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.656951 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.657136 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.657137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.657424 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.657673 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.657675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.658609 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.658610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.659741 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.659743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.660183 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.660184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.660311 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.681486 (+ 21175us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.681492 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.681986 (+ 494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.683767 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.683768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.683768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.683931 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.684130 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.684131 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.684131 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.684187 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.684434 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.684435 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.684477 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.684560 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.684659 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":201,"threads_started":1}
I20260811 10:02:52.690565 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 16810
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442571, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.254@KRBTEST.COM for oryx/127.9.127.252@KRBTEST.COM
I20260811 10:02:52.699581 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.686955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.0.0.1:59762)
0811 10:02:52.687002 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.687011 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.687045 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.687274 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.687275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.687385 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.687437 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.687439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.688285 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.688285 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.688762 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.688763 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.689221 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.689222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.689267 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.689669 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.689673 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.696666 (+ 6993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.698504 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.698505 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.698505 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.698733 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.698935 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.698936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.698936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.698991 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.699280 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.699288 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.699341 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.699399 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.699493 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 10:02:52.699903 17535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.687106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59762 (local address 127.9.127.252:44761)
0811 10:02:52.687156 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.687158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.687166 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:52.687195 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.687196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.687204 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.687255 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.687508 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.688216 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.688876 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.689155 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.689231 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.696777 (+ 7546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.696778 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.696779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.696785 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.698413 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.698811 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.698812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.698812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.698862 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.699054 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.699055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.699055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.699163 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.699233 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.699756 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.699825 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 10:02:52.700309 16739 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.9.127.252:44761: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815"
member_type: NON_VOTER
last_known_addr {
host: "127.9.127.252"
port: 44761
}
attrs {
promote: true
}
}
dest_uuid: "28671cfc014e42168bd8c2da70aba713"
cas_config_opid_index: 5
I20260811 10:02:52.700610 16739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } }
I20260811 10:02:52.701064 17354 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.701555 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:38489
--local_ip_for_outbound_sockets=127.9.127.193
--tserver_master_addrs=127.9.127.254:38819
--webserver_port=34007
--webserver_interface=127.9.127.193
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab
--principal=oryx/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101,127.9.127.252:44761 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:02:52.702098 17354 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.9.127.252:44761
I20260811 10:02:52.702176 17354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.702247 17354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:52.702582 17501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:52.703285 17456 master.cc:537] Master@127.9.127.252:44761 shutting down...
I20260811 10:02:52.703644 17501 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 FOLLOWER]: Refusing update from remote peer 28671cfc014e42168bd8c2da70aba713: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 10:02:52.705549 17353 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:52.706159 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.702442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.0.0.1:40312)
0811 10:02:52.702742 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.702751 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.702791 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.703025 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.703026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.703027 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:52.703061 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.703063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.703950 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.703951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.705095 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.705098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.705916 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.705917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.705992 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.706012 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.706062 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.706099 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286}
I20260811 10:02:52.706322 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.702535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40312 (local address 127.9.127.253:38101)
0811 10:02:52.702714 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.702716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.702839 (+ 123us) server_negotiation.cc:407] Connection header received
0811 10:02:52.702862 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.702863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.702886 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.702972 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:52.703129 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.703850 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.705193 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.705753 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.705818 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.705884 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.706228 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.706262 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
W20260811 10:02:52.706936 16720 consensus_peers.cc:487] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 -> Peer b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252:44761): Couldn't send request to peer b6434f7a92a24ac6ae905eb33d1b3815. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 10:02:52.706959 17407 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 LEARNER]: Refusing update from remote peer 28671cfc014e42168bd8c2da70aba713: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 10:02:52.708308 17456 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:52.708398 17456 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:52.708448 17456 tablet_replica.cc:330] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: stopping tablet replica
I20260811 10:02:52.709980 17353 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 10:02:52.711453 17407 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.712730 17438 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28671cfc014e42168bd8c2da70aba713. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.712847 17438 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: This master's current role is: LEARNER
I20260811 10:02:52.712893 17438 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: NON_VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: true } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.712949 17438 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: This master's current role is: LEARNER
I20260811 10:02:52.713235 17353 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: attempting to promote NON_VOTER fcc14517fe694ca0af77c3a9e8aff60a to VOTER
I20260811 10:02:52.713413 17353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } }
I20260811 10:02:52.713882 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.713760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.0.0.1:59776)
0811 10:02:52.713819 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.713859 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:44761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 10:02:52.713903 17407 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 LEARNER]: Refusing update from remote peer 28671cfc014e42168bd8c2da70aba713: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 10:02:52.714210 17355 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 10:02:52.714377 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.714305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.0.0.1:59780)
0811 10:02:52.714333 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.714359 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:44761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260811 10:02:52.714787 16720 consensus_peers.cc:487] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 -> Peer b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252:44761): Couldn't send request to peer b6434f7a92a24ac6ae905eb33d1b3815. Status: Network error: Client connection negotiation failed: client connection to 127.9.127.252:44761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 10:02:52.714956 17354 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, fcc14517fe694ca0af77c3a9e8aff60a (127.9.127.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.715878 17354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.715943 17354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:52.715983 17354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.716018 17354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:52.716316 17407 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, fcc14517fe694ca0af77c3a9e8aff60a (127.9.127.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.717389 17560 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.717523 17560 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:02:52.722046 17456 master.cc:552] Master@127.9.127.252:44761 shutdown complete.
I20260811 10:02:52.722093 17456 master_runner.cc:305] Clearing existing system tablet
I20260811 10:02:52.722221 17456 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.722266 17456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.722929 17456 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:52.723408 17562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.723511 17456 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.723556 17456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.723577 17456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
uuid: "b6434f7a92a24ac6ae905eb33d1b3815"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "382a32430da4979d2369743625596bdf"
server_key_iv: "dc7ced31a86f71c87ef0f7794414be59"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.724268 17456 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:52.725839 17456 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 10:02:52.725906 17456 log.cc:1196] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 10:02:52.726083 17456 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Deleting consensus metadata
I20260811 10:02:52.726200 17456 master_runner.cc:315] Copying system tablet from 127.9.127.254:38819
I20260811 10:02:52.726779 17456 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: tablet copy: Beginning tablet copy session from remote peer at address 127.9.127.254:38819
I20260811 10:02:52.735570 17569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.727032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:46908)
0811 10:02:52.728914 (+ 1882us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.728934 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.729011 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.729169 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.729169 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.729355 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.729406 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.729408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.730272 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.730273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.731030 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.731033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.731477 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.731478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.731544 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.732023 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.732029 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.732418 (+ 389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.734306 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.734307 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.734307 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.734548 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.734813 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.734814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.734815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.734900 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.735174 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.735175 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.735223 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.735303 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.735459 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1869,"thread_start_us":43,"threads_started":1}
I20260811 10:02:52.735670 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.727085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46908 (local address 127.9.127.254:38819)
0811 10:02:52.727121 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.727123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.728984 (+ 1861us) server_negotiation.cc:407] Connection header received
0811 10:02:52.729086 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.729088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.729099 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.729159 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.729485 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.730187 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.731112 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.731388 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.731457 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.732532 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.732533 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.732533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.732552 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.734210 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.734637 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.734638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.734639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.734702 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.734974 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.734975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.734975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.735093 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.735160 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.735468 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.735592 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:52.736254 16762 tablet_copy_service.cc:140] P 28671cfc014e42168bd8c2da70aba713: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b6434f7a92a24ac6ae905eb33d1b3815 ({username='oryx', principal='oryx/127.9.127.252@KRBTEST.COM'} at 127.0.0.1:46908)
I20260811 10:02:52.736316 16762 tablet_copy_service.cc:161] P 28671cfc014e42168bd8c2da70aba713: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b6434f7a92a24ac6ae905eb33d1b3815 at {username='oryx', principal='oryx/127.9.127.252@KRBTEST.COM'} at 127.0.0.1:46908: session id = b6434f7a92a24ac6ae905eb33d1b3815-00000000000000000000000000000000
I20260811 10:02:52.736925 16762 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 10:02:52.737356 17456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 10:02:52.738493 17456 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: tablet copy: Starting download of 0 data blocks...
I20260811 10:02:52.738626 17456 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: tablet copy: Starting download of 1 WAL segments...
I20260811 10:02:52.739320 17456 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 10:02:52.740216 16762 tablet_copy_service.cc:342] P 28671cfc014e42168bd8c2da70aba713: Request end of tablet copy session b6434f7a92a24ac6ae905eb33d1b3815-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.9.127.252@KRBTEST.COM'} at 127.0.0.1:46908
I20260811 10:02:52.740272 16762 tablet_copy_service.cc:433] P 28671cfc014e42168bd8c2da70aba713: ending tablet copy session b6434f7a92a24ac6ae905eb33d1b3815-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b6434f7a92a24ac6ae905eb33d1b3815
I20260811 10:02:52.743149 17456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:52.744328 17573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.744484 17570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:52.748939 17456 server_base.cc:1034] running on GCE node
W20260811 10:02:52.749039 17571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:52.749197 17456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:52.749348 17456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:52.750484 17456 hybrid_clock.cc:648] HybridClock initialized: now 1786442572750475 us; error 35 us; skew 500 ppm
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:52.752096 17456 init.cc:377] Logged in from keytab as oryx/127.9.127.252@KRBTEST.COM (short username oryx)
I20260811 10:02:52.752430 17456 webserver.cc:460] Webserver started at http://127.9.127.252:34417/ using document root <none> and password file <none>
I20260811 10:02:52.752576 17456 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.752625 17456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.753571 17456 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:52.754213 17580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.754372 17456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:52.754436 17456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
uuid: "b6434f7a92a24ac6ae905eb33d1b3815"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "382a32430da4979d2369743625596bdf"
server_key_iv: "dc7ced31a86f71c87ef0f7794414be59"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.754490 17456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.791281 17456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:52.793426 17456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:52.797535 17456 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.252:44761
I20260811 10:02:52.798092 17456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
I20260811 10:02:52.798523 17637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.252:44761 every 8 connection(s)
I20260811 10:02:52.799157 17639 sys_catalog.cc:263] Verifying existing consensus state
I20260811 10:02:52.799679 17639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Bootstrap starting.
I20260811 10:02:52.802347 17639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:02:52.802568 17639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: Bootstrap complete.
I20260811 10:02:52.802749 17639 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } }
I20260811 10:02:52.802835 17639 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6434f7a92a24ac6ae905eb33d1b3815, State: Initialized, Role: LEARNER
I20260811 10:02:52.802877 17639 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } }
I20260811 10:02:52.803048 17639 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:52.803064 17642 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:52.803303 17642 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: This master's current role is: LEARNER
I20260811 10:02:52.804340 17655 catalog_manager.cc:1259] Loaded cluster ID: 945b4df57bc34993adac2bde4a73cee9
I20260811 10:02:52.804905 17655 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: loading cluster ID for follower catalog manager: success
I20260811 10:02:52.806137 17655 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: acquiring CA information for follower catalog manager: success
I20260811 10:02:52.806558 17655 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 10:02:52.814766 17558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:52.815009 17558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:52.815060 17558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:52.816273 17558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:52.816352 17558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:52.816399 17558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:52.818091 17558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab
--principal=oryx/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:38489
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=34007
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101,127.9.127.252:44761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:52.818320 17558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:52.818514 17558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:52.823673 17661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.823678 17664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:52.823746 17660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:52.824290 17558 server_base.cc:1034] running on GCE node
I20260811 10:02:52.824512 17558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:52.824743 17558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:52.825917 17558 hybrid_clock.cc:648] HybridClock initialized: now 1786442572825906 us; error 28 us; skew 500 ppm
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:52.831797 17558 init.cc:377] Logged in from keytab as oryx/127.9.127.193@KRBTEST.COM (short username oryx)
I20260811 10:02:52.832243 17558 webserver.cc:460] Webserver started at http://127.9.127.193:34007/ using document root <none> and password file <none>
I20260811 10:02:52.832479 17558 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:52.832551 17558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:52.836621 17558 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260811 10:02:52.838032 17675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.838316 17558 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 10:02:52.838423 17558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "d07e5e0a714a40d8913d6deb159e2a85"
format_stamp: "Formatted at 2026-08-11 10:02:51 on dist-test-slave-1x4g"
server_key: "5acc6cc04085b72d6409f7c5c649e35f"
server_key_iv: "0b9c3ec0c0b917e2357a49175b35062f"
server_key_version: "encryptionkey@0"
I20260811 10:02:52.838861 17558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:52.864603 17558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:52.866777 17558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:52.867000 17558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:52.867357 17558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:52.867746 17558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:52.867810 17558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.867851 17558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:52.867911 17558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:52.879329 17558 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:38489
I20260811 10:02:52.879370 17801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:38489 every 8 connection(s)
I20260811 10:02:52.879761 17558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.252@KRBTEST.COM
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
Aug 11 10:02:52 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442572, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.253@KRBTEST.COM
I20260811 10:02:52.888806 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 17558
I20260811 10:02:52.888993 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 16958
I20260811 10:02:52.899276 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.880646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:34857 (local address 127.9.127.252:44761)
0811 10:02:52.880853 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.880855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.881105 (+ 250us) server_negotiation.cc:407] Connection header received
0811 10:02:52.882224 (+ 1119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.882226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.882240 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.882350 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.883254 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.884059 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885229 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.885532 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885608 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.888068 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.888069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.888070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.888078 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.897342 (+ 9264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.898188 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.898189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.898189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.898258 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.898489 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.898490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.898491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.898609 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.898693 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.899022 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.899125 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260811 10:02:52.899292 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.881174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:43913 (local address 127.9.127.254:38819)
0811 10:02:52.881234 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.881236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.881384 (+ 148us) server_negotiation.cc:407] Connection header received
0811 10:02:52.882152 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.882153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.882169 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.882234 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.882984 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.883663 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885146 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.885441 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885515 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.888620 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.888622 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.888622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.888629 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.890357 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.898187 (+ 7830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.898188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.898189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.898261 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.898488 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.898489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.898490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.898635 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.898684 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.899031 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.899137 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 10:02:52.899953 17807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.880607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.9.127.193:34857)
0811 10:02:52.880957 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.880993 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.882038 (+ 1045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.882425 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.882429 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.882868 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.883147 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.883150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.884140 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.884141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.885150 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.885152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.885611 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.885759 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.886454 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.886458 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.887972 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.897434 (+ 9462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.897435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.897436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.898098 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.898317 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.898317 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.898317 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.898410 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.898687 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.898693 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.898861 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.899384 (+ 523us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.899611 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":9,"thread_start_us":214,"threads_started":1}
I20260811 10:02:52.900144 17808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.881058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.193:43913)
0811 10:02:52.881264 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.881283 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.882046 (+ 763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.882431 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.882431 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.882712 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.882881 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.882885 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.883911 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.883912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.885033 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.885036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.885530 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.885679 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.886272 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.886276 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.888517 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.890463 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.890470 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.890471 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.898082 (+ 7611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.898345 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.898345 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.898346 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.898413 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.898739 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.898740 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.898862 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.899426 (+ 564us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.899953 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":372,"thread_start_us":133,"threads_started":1}
I20260811 10:02:52.901594 17802 heartbeater.cc:347] Connected to a master server at 127.9.127.252:44761
I20260811 10:02:52.901705 17802 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:52.901895 17802 heartbeater.cc:511] Master 127.9.127.252:44761 requested a full tablet report, sending...
I20260811 10:02:52.902041 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.881435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:55599 (local address 127.9.127.253:38101)
0811 10:02:52.881514 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:52.881516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:52.881707 (+ 191us) server_negotiation.cc:407] Connection header received
0811 10:02:52.882232 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:52.882233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:52.882245 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:52.882323 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:52.883445 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.884171 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885285 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.885496 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885562 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.898801 (+ 13239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:52.898802 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:52.898802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:52.898809 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:52.900720 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.901106 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.901107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.901107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.901180 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:52.901449 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:52.901450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:52.901451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:52.901611 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:52.901669 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:52.901876 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 10:02:52.901960 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 10:02:52.902190 17809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:52.881428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.9.127.193:55599)
0811 10:02:52.881607 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:52.881617 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:52.882049 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:52.882425 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:52.882429 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:52.883151 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:52.883342 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.883345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.884294 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.884295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.885150 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:52.885152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:52.885616 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:52.885617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:52.885686 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:52.886241 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:52.886253 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:52.897995 (+ 11742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:52.900852 (+ 2857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.900853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.900853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.901029 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.901277 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:52.901278 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:52.901278 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:52.901366 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:52.901708 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:52.901709 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:52.901753 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 10:02:52.901820 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 10:02:52.901949 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":6,"thread_start_us":140,"threads_started":1}
I20260811 10:02:52.902420 17600 ts_manager.cc:194] Registered new tserver with Master: d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489)
I20260811 10:02:52.902858 17803 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38819
I20260811 10:02:52.902942 17803 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:52.902858 17804 heartbeater.cc:347] Connected to a master server at 127.9.127.253:38101
I20260811 10:02:52.902982 17804 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:52.903010 17803 heartbeater.cc:511] Master 127.9.127.254:38819 requested a full tablet report, sending...
I20260811 10:02:52.903038 17804 heartbeater.cc:511] Master 127.9.127.253:38101 requested a full tablet report, sending...
I20260811 10:02:52.903295 16739 ts_manager.cc:194] Re-registered known tserver with Master: d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489)
I20260811 10:02:52.903427 17396 ts_manager.cc:194] Registered new tserver with Master: d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489)
I20260811 10:02:52.903699 16739 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:43913
I20260811 10:02:52.903723 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:41101
--local_ip_for_outbound_sockets=127.9.127.194
--tserver_master_addrs=127.9.127.254:38819
--webserver_port=35019
--webserver_interface=127.9.127.194
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab
--principal=oryx/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101,127.9.127.252:44761 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:52.997071 17811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:52.997310 17811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:52.997350 17811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:52.999037 17811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:52.999100 17811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:52.999145 17811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:53.001332 17811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab
--principal=oryx/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:41101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=35019
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101,127.9.127.252:44761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:53.001586 17811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:53.001842 17811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:53.006829 17817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:53.006799 17820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:53.007040 17811 server_base.cc:1034] running on GCE node
W20260811 10:02:53.006803 17818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:53.007314 17811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:53.007553 17811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:53.008718 17811 hybrid_clock.cc:648] HybridClock initialized: now 1786442573008694 us; error 42 us; skew 500 ppm
Aug 11 10:02:53 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442573, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:53.011171 17811 init.cc:377] Logged in from keytab as oryx/127.9.127.194@KRBTEST.COM (short username oryx)
I20260811 10:02:53.011585 17811 webserver.cc:460] Webserver started at http://127.9.127.194:35019/ using document root <none> and password file <none>
I20260811 10:02:53.011802 17811 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:53.011881 17811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:53.013358 17811 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:53.013911 17827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:53.014086 17811 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:53.014185 17811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "2e7757f92d594855ab67edbe5e7a14fa"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "6bdb524bfe278082343fc8d8c9388603"
server_key_iv: "b8993a6f9635e4bda0f55ac17f4f74cf"
server_key_version: "encryptionkey@0"
I20260811 10:02:53.014500 17811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:53.037851 17811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:53.039610 17811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:53.039764 17811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:53.039970 17811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:53.040241 17811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:53.040308 17811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:53.040349 17811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:53.040390 17811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:53.048214 17811 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:41101
I20260811 10:02:53.048269 17947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:41101 every 8 connection(s)
I20260811 10:02:53.048629 17811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:53.049445 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 17811
I20260811 10:02:53.049619 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 17104
Aug 11 10:02:53 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442573, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.253@KRBTEST.COM
Aug 11 10:02:53 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442573, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.252@KRBTEST.COM
I20260811 10:02:53.063947 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.049512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:45741 (local address 127.9.127.252:44761)
0811 10:02:53.049597 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.049599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.049931 (+ 332us) server_negotiation.cc:407] Connection header received
0811 10:02:53.050633 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.050634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.050650 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.050691 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.051872 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.052714 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.054239 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.054545 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.054609 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.059189 (+ 4580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.059191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.059191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.059199 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.062397 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.062956 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.062957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.062958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.063033 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.063254 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.063255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.063255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.063392 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.063429 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.063754 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.063847 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 10:02:53.064055 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.050129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:42009 (local address 127.9.127.253:38101)
0811 10:02:53.051285 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.051288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.052047 (+ 759us) server_negotiation.cc:407] Connection header received
0811 10:02:53.052114 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.052116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.052129 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.052186 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.052754 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.053515 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.054500 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.054775 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.054832 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.058785 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.058786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.058786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.058793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.060655 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.062912 (+ 2257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.062913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.062913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.062970 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.063300 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.063301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.063302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.063501 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.063553 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.063813 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.063909 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1127}
I20260811 10:02:53.064565 17953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.049491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.9.127.194:45741)
0811 10:02:53.049767 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.049817 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.050528 (+ 711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.050855 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.050859 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.051480 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:53.051765 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.051771 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.052949 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.052949 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.054145 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.054148 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.054709 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.054710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.054916 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.055621 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:53.055633 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:53.059085 (+ 3452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:53.062509 (+ 3424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.062510 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.062511 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.062838 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.063113 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.063114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.063115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.063195 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.063466 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:53.063471 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:53.063627 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.064086 (+ 459us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.064281 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":90,"threads_started":1}
I20260811 10:02:53.064600 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.049770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.9.127.194:42009)
0811 10:02:53.051957 (+ 2187us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.051969 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.052045 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.052236 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.052237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.052579 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:53.052659 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.052661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.053611 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.053612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.054419 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.054420 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.054966 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.054966 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.055093 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.055680 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:53.055686 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:53.058694 (+ 3008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:53.061176 (+ 2482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.061184 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.061187 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.062835 (+ 1648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.063032 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.063032 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.063033 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.063202 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.063609 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:53.063610 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:53.063666 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.064183 (+ 517us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.064384 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2168,"mutex_wait_us":43,"thread_start_us":51,"threads_started":1}
Aug 11 10:02:53 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442573, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:53.065241 17950 heartbeater.cc:347] Connected to a master server at 127.9.127.253:38101
I20260811 10:02:53.065344 17950 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:53.065553 17950 heartbeater.cc:511] Master 127.9.127.253:38101 requested a full tablet report, sending...
I20260811 10:02:53.066025 17396 ts_manager.cc:194] Registered new tserver with Master: 2e7757f92d594855ab67edbe5e7a14fa (127.9.127.194:41101)
I20260811 10:02:53.068552 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.050730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:44047 (local address 127.9.127.254:38819)
0811 10:02:53.050788 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.050790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.052230 (+ 1440us) server_negotiation.cc:407] Connection header received
0811 10:02:53.052361 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.052363 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.052378 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.052411 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.053017 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.053986 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.055369 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.055677 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.055759 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.065829 (+ 10070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.065830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.065830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.065838 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.067355 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.067701 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.067702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.067702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.067798 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.068008 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.068009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.068009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.068150 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.068224 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.068379 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.068452 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 10:02:53.068625 17954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.049896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.194:44047)
0811 10:02:53.052168 (+ 2272us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.052178 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.052261 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.052505 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.052506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.052757 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:53.052890 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.052893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.054094 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.054095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.055262 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.055266 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.055912 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.055914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.055997 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.061564 (+ 5567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:53.061569 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:53.065747 (+ 4178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:53.067455 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.067456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.067457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.067624 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.067871 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.067872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.067872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.067930 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.068229 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:53.068230 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:53.068271 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.068353 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.068451 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2247,"thread_start_us":52,"threads_started":1}
I20260811 10:02:53.068986 17948 heartbeater.cc:347] Connected to a master server at 127.9.127.252:44761
I20260811 10:02:53.069043 17948 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:53.069115 17948 heartbeater.cc:511] Master 127.9.127.252:44761 requested a full tablet report, sending...
I20260811 10:02:53.069299 17949 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38819
I20260811 10:02:53.069362 17949 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:53.069383 17600 ts_manager.cc:194] Registered new tserver with Master: 2e7757f92d594855ab67edbe5e7a14fa (127.9.127.194:41101)
I20260811 10:02:53.069439 17949 heartbeater.cc:511] Master 127.9.127.254:38819 requested a full tablet report, sending...
I20260811 10:02:53.069675 16739 ts_manager.cc:194] Re-registered known tserver with Master: 2e7757f92d594855ab67edbe5e7a14fa (127.9.127.194:41101)
I20260811 10:02:53.070102 16739 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:44047
I20260811 10:02:53.071305 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:43845
--local_ip_for_outbound_sockets=127.9.127.195
--tserver_master_addrs=127.9.127.254:38819
--webserver_port=34373
--webserver_interface=127.9.127.195
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab
--principal=oryx/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101,127.9.127.252:44761 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:53.154227 17956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:53.154438 17956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:53.154474 17956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:53.155666 17956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:53.155725 17956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:53.155766 17956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:53.157234 17956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab
--principal=oryx/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:43845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=34373
--tserver_master_addrs=127.9.127.254:38819,127.9.127.253:38101,127.9.127.252:44761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:53.157495 17956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:53.157716 17956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:53.163048 17965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:53.163062 17963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:53.163148 17956 server_base.cc:1034] running on GCE node
W20260811 10:02:53.163112 17962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:53.163403 17956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:53.163672 17956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:53.164832 17956 hybrid_clock.cc:648] HybridClock initialized: now 1786442573164825 us; error 29 us; skew 500 ppm
Aug 11 10:02:53 dist-test-slave-1x4g krb5kdc[16687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442573, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:53.167388 17956 init.cc:377] Logged in from keytab as oryx/127.9.127.195@KRBTEST.COM (short username oryx)
I20260811 10:02:53.167816 17956 webserver.cc:460] Webserver started at http://127.9.127.195:34373/ using document root <none> and password file <none>
I20260811 10:02:53.168053 17956 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:53.168138 17956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:53.169585 17956 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:53.170199 17973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:53.170411 17956 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:53.170527 17956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "db968ae00ef74e139f64b4c33529b824"
format_stamp: "Formatted at 2026-08-11 10:02:52 on dist-test-slave-1x4g"
server_key: "b1e5b67914243bfd92038cf5fb3951ab"
server_key_iv: "3a79bf24926891a0a170dc4661698f66"
server_key_version: "encryptionkey@0"
I20260811 10:02:53.170854 17956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:53.188493 17956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:53.190330 17956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:53.190493 17956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:53.190726 17956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:02:53.191033 17956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:53.191097 17956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:53.191135 17956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:53.191162 17956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:53.197505 17956 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:43845
I20260811 10:02:53.197547 18098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:43845 every 8 connection(s)
I20260811 10:02:53.197942 17956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
Aug 11 10:02:53 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442573, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.252@KRBTEST.COM
Aug 11 10:02:53 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442573, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.253@KRBTEST.COM
Aug 11 10:02:53 dist-test-slave-1x4g krb5kdc[16687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442573, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:53.206445 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 17956
I20260811 10:02:53.209755 18105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.198957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.9.127.195:49343)
0811 10:02:53.199165 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.199177 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.200141 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.200399 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.200402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.200830 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:53.201040 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.201045 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.201757 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.201758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.202641 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.202643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.203061 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.203062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.203233 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.203843 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:53.203854 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:53.205619 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:53.207901 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.207908 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.207911 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.208261 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.208504 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.208505 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.208505 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.208639 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.209003 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:53.209011 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:53.209195 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.209305 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.209507 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":76,"threads_started":1}
I20260811 10:02:53.209926 18106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.199126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.9.127.195:45881)
0811 10:02:53.199346 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.199356 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.200190 (+ 834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.200410 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.200410 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.200829 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:53.201040 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.201047 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.202026 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.202027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.203002 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.203003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.203540 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.203541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.203661 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.204071 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:53.204076 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:53.206116 (+ 2040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:53.208739 (+ 2623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.208740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.208741 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.209066 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.209277 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.209278 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.209278 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.209336 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.209633 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:53.209634 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:53.209674 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.209729 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.209838 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":42,"thread_start_us":95,"threads_started":1}
I20260811 10:02:53.210057 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.198709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:49943 (local address 127.9.127.254:38819)
0811 10:02:53.198773 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.198775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.199008 (+ 233us) server_negotiation.cc:407] Connection header received
0811 10:02:53.200288 (+ 1280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.200289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.200303 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.200338 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.201159 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.201925 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.203107 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.203415 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.203452 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.206806 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.206807 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.206808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.206815 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.208576 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.209098 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.209099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.209100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.209164 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.209379 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.209379 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.209380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.209540 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.209606 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.209853 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.209946 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:02:53.210222 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.199080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:49343 (local address 127.9.127.252:44761)
0811 10:02:53.199147 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.199150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.199225 (+ 75us) server_negotiation.cc:407] Connection header received
0811 10:02:53.200246 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.200247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.200260 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.200315 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.201135 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.201637 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.202732 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.202975 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.203049 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.205711 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.205713 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.205713 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.205720 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.207798 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.208354 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.208355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.208356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.208420 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.208715 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.208716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.208717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.208882 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.208955 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.209983 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.210099 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 10:02:53.210543 18104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.198699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.195:49943)
0811 10:02:53.198877 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.198913 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.200137 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.200409 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.200410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.200829 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:53.201040 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.201047 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.202026 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.202027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.202992 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.202995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.203542 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.203543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.203613 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.204181 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:53.204186 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:53.206697 (+ 2511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:53.208669 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.208670 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.208670 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.209012 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.209240 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:53.209241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:53.209241 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:53.209306 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:53.209636 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:53.209637 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:53.209680 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.209739 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.210409 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":632,"thread_start_us":95,"threads_started":1}
I20260811 10:02:53.210793 18099 heartbeater.cc:347] Connected to a master server at 127.9.127.252:44761
I20260811 10:02:53.210898 18099 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:53.210925 18100 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38819
I20260811 10:02:53.210964 18100 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:53.211047 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.199336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:45881 (local address 127.9.127.253:38101)
0811 10:02:53.199403 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.199405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.199423 (+ 18us) server_negotiation.cc:407] Connection header received
0811 10:02:53.200292 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.200294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.200307 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.200338 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.201159 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.201924 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.203097 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.203395 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.203438 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.206256 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.206258 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.206258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.206267 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.208660 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.209146 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.209147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.209147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.209207 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.209404 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.209405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.209405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.209532 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.209604 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.210854 (+ 1250us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.210943 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:02:53.211108 18100 heartbeater.cc:511] Master 127.9.127.254:38819 requested a full tablet report, sending...
I20260811 10:02:53.211108 18099 heartbeater.cc:511] Master 127.9.127.252:44761 requested a full tablet report, sending...
I20260811 10:02:53.211542 16739 ts_manager.cc:194] Re-registered known tserver with Master: db968ae00ef74e139f64b4c33529b824 (127.9.127.195:43845)
I20260811 10:02:53.211611 18101 heartbeater.cc:347] Connected to a master server at 127.9.127.253:38101
I20260811 10:02:53.211647 18101 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:53.211707 18101 heartbeater.cc:511] Master 127.9.127.253:38101 requested a full tablet report, sending...
I20260811 10:02:53.211778 17600 ts_manager.cc:194] Registered new tserver with Master: db968ae00ef74e139f64b4c33529b824 (127.9.127.195:43845)
I20260811 10:02:53.211964 17396 ts_manager.cc:194] Registered new tserver with Master: db968ae00ef74e139f64b4c33529b824 (127.9.127.195:43845)
I20260811 10:02:53.212056 16739 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:49943
I20260811 10:02:53.218590 18113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.208079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40320 (local address 127.9.127.253:38101)
0811 10:02:53.208874 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.208876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.208883 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:53.208904 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.208904 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.208917 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.209000 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.210064 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.212466 (+ 2402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.213370 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.213695 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.213774 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.215144 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.215145 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.215146 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.215153 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.217153 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.217666 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.217667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.217667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.217733 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.218005 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.218006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.218006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.218149 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.218244 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.218349 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.218430 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":772,"thread_start_us":67,"threads_started":1}
I20260811 10:02:53.219682 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.208421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59792 (local address 127.9.127.252:44761)
0811 10:02:53.208647 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.208649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.209920 (+ 1271us) server_negotiation.cc:407] Connection header received
0811 10:02:53.209943 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.209944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.209955 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.210007 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.212768 (+ 2761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.213549 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.214493 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.214714 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.214803 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.216310 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.216311 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.216311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.216319 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.218264 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.218740 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.218741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.218742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.218810 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.219031 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.219032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.219032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.219196 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.219295 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.219450 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.219543 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":65,"threads_started":1}
I20260811 10:02:53.221292 18111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.207541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46924 (local address 127.9.127.254:38819)
0811 10:02:53.207682 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.207685 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.210811 (+ 3126us) server_negotiation.cc:407] Connection header received
0811 10:02:53.211649 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.211650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.211663 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.211709 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.213321 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.214273 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.215412 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.215747 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.215832 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.218143 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.218145 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.218145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.218153 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.220119 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.220494 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.220495 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.220495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.220549 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.220715 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.220715 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.220716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.220944 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.221020 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.221113 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.221176 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":92,"threads_started":1}
I20260811 10:02:53.222711 16739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:53.224462 16739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:53.232194 18124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.228126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43845 (local address 127.0.0.1:36294)
0811 10:02:53.228263 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.228274 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.228344 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.228771 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.228790 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.228793 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:53.228841 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.228844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.230087 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.230089 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.231046 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.231049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.231964 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.231965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.232025 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.232030 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.232081 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.232120 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":33,"thread_start_us":46,"threads_started":1}
I20260811 10:02:53.232439 18126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.228291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36294 (local address 127.9.127.195:43845)
0811 10:02:53.228495 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.228500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.228509 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:53.228569 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.228571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.228598 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.228802 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:53.228911 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.229994 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.231136 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.231783 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.231852 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.231928 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.232304 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.232350 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":72,"threads_started":1}
I20260811 10:02:53.232509 18123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.228173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38489 (local address 127.0.0.1:53250)
0811 10:02:53.229024 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.229031 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.229085 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.229265 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.229266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.229268 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:53.229314 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.229316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.230129 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.230130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.231403 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.231406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.232308 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.232309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.232365 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.232369 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.232398 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.232430 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":845,"mutex_wait_us":32,"thread_start_us":86,"threads_started":1}
I20260811 10:02:53.233060 18128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.228667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53250 (local address 127.9.127.193:38489)
0811 10:02:53.228859 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.228864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.229087 (+ 223us) server_negotiation.cc:407] Connection header received
0811 10:02:53.229156 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.229158 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.229174 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.229268 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:53.229370 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.230029 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.231495 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.232210 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.232828 (+ 618us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.232919 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.232947 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.232987 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":105,"threads_started":1}
I20260811 10:02:53.233166 18027 tablet_service.cc:1467] Processing CreateTablet for tablet 6833055652db4aa4a322b63ed541939e (DEFAULT_TABLE table=test-table [id=b2b0efd3ffc644baa8a6e0e4d21487fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:53.233518 18027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6833055652db4aa4a322b63ed541939e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:53.233660 17727 tablet_service.cc:1467] Processing CreateTablet for tablet 6833055652db4aa4a322b63ed541939e (DEFAULT_TABLE table=test-table [id=b2b0efd3ffc644baa8a6e0e4d21487fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:53.234009 17727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6833055652db4aa4a322b63ed541939e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:53.236065 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.232021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59806 (local address 127.9.127.252:44761)
0811 10:02:53.232056 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.232058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.232156 (+ 98us) server_negotiation.cc:407] Connection header received
0811 10:02:53.232258 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.232259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.232282 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.232317 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:53.232822 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.233474 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.234992 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.235723 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.235807 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.235879 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.235958 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.236000 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:02:53.236076 18130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.231865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.0.0.1:59806)
0811 10:02:53.232099 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.232109 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.232179 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.232667 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.232667 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.232670 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:53.232712 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.232714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.233676 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.233677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.234885 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.234888 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.235826 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.235827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.235891 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.235895 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.235951 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.235999 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":72,"threads_started":1}
I20260811 10:02:53.236886 17611 raft_consensus.cc:1203] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 10:02:53.237186 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.228130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:41101 (local address 127.0.0.1:57772)
0811 10:02:53.228898 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.228907 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.228968 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.229197 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.229198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.229200 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:53.229238 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.229239 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.230418 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.230420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.231493 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.231495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.236921 (+ 5426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.236922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.236987 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.236991 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.237044 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.237084 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"thread_start_us":91,"threads_started":1}
I20260811 10:02:53.237577 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.228419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57772 (local address 127.9.127.194:41101)
0811 10:02:53.228652 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.228656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.228968 (+ 312us) server_negotiation.cc:407] Connection header received
0811 10:02:53.229025 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.229027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.229044 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.229129 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:53.229310 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.230328 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.231585 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.232371 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.232466 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.237389 (+ 4923us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.237418 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.237468 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":135,"threads_started":1}
I20260811 10:02:53.237815 17642 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28671cfc014e42168bd8c2da70aba713. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:53.237911 17642 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: This master's current role is: LEARNER
I20260811 10:02:53.238451 17879 tablet_service.cc:1467] Processing CreateTablet for tablet 6833055652db4aa4a322b63ed541939e (DEFAULT_TABLE table=test-table [id=b2b0efd3ffc644baa8a6e0e4d21487fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:53.238750 17879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6833055652db4aa4a322b63ed541939e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:53.241827 18136 tablet_bootstrap.cc:492] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Bootstrap starting.
I20260811 10:02:53.242022 18131 tablet_bootstrap.cc:492] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Bootstrap starting.
I20260811 10:02:53.242144 18137 tablet_bootstrap.cc:492] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Bootstrap starting.
I20260811 10:02:53.242687 18137 tablet_bootstrap.cc:654] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:53.242949 18136 tablet_bootstrap.cc:654] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:53.243007 18131 tablet_bootstrap.cc:654] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:53.243348 18137 log.cc:824] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:53.243528 18131 log.cc:824] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:53.243603 18136 log.cc:824] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:53.244243 18137 tablet_bootstrap.cc:492] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: No bootstrap required, opened a new log
I20260811 10:02:53.244326 18137 ts_tablet_manager.cc:1397] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:53.244374 18136 tablet_bootstrap.cc:492] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: No bootstrap required, opened a new log
I20260811 10:02:53.244410 18131 tablet_bootstrap.cc:492] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: No bootstrap required, opened a new log
I20260811 10:02:53.244448 18136 ts_tablet_manager.cc:1397] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:02:53.244460 18131 ts_tablet_manager.cc:1397] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:02:53.246881 18137 raft_consensus.cc:348] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.247044 18137 raft_consensus.cc:374] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:53.247092 18137 raft_consensus.cc:729] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7757f92d594855ab67edbe5e7a14fa, State: Initialized, Role: FOLLOWER
I20260811 10:02:53.247243 18137 consensus_queue.cc:260] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.247538 18137 ts_tablet_manager.cc:1428] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 10:02:53.247625 17949 heartbeater.cc:503] Master 127.9.127.254:38819 was elected leader, sending a full tablet report...
I20260811 10:02:53.248055 18136 raft_consensus.cc:348] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.248216 18136 raft_consensus.cc:374] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:53.248255 18136 raft_consensus.cc:729] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d07e5e0a714a40d8913d6deb159e2a85, State: Initialized, Role: FOLLOWER
I20260811 10:02:53.248302 18131 raft_consensus.cc:348] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.248387 18136 consensus_queue.cc:260] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.248442 18131 raft_consensus.cc:374] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:53.248479 18131 raft_consensus.cc:729] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db968ae00ef74e139f64b4c33529b824, State: Initialized, Role: FOLLOWER
I20260811 10:02:53.248651 18136 ts_tablet_manager.cc:1428] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260811 10:02:53.248637 18131 consensus_queue.cc:260] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.248788 17803 heartbeater.cc:503] Master 127.9.127.254:38819 was elected leader, sending a full tablet report...
I20260811 10:02:53.249208 18131 ts_tablet_manager.cc:1428] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 10:02:53.249527 18100 heartbeater.cc:503] Master 127.9.127.254:38819 was elected leader, sending a full tablet report...
W20260811 10:02:53.299597 17952 tablet.cc:2369] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:02:53.381013 17805 tablet.cc:2369] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:02:53.448881 18103 tablet.cc:2369] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:53.582074 18141 raft_consensus.cc:482] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:53.582213 18141 raft_consensus.cc:504] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.582582 18141 leader_election.cc:288] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db968ae00ef74e139f64b4c33529b824 (127.9.127.195:43845), d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489)
I20260811 10:02:53.585565 18128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.582881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:36051 (local address 127.9.127.193:38489)
0811 10:02:53.582926 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.582928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.583028 (+ 100us) server_negotiation.cc:407] Connection header received
0811 10:02:53.583122 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.583123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.583132 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.583206 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:53.583344 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.583823 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.584845 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.585209 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.585296 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.585305 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.585444 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.585485 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:53.585590 18145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.582802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38489 (local address 127.9.127.194:36051)
0811 10:02:53.582942 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.582953 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.583042 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.583209 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.583210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.583213 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:53.583263 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.583265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.583921 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.583922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.584715 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.584717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.585296 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.585297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.585368 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.585372 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.585438 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.585482 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":22,"thread_start_us":60,"threads_started":1}
I20260811 10:02:53.585606 18126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.582865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:45117 (local address 127.9.127.195:43845)
0811 10:02:53.582917 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.582920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.583010 (+ 90us) server_negotiation.cc:407] Connection header received
0811 10:02:53.583100 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.583101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.583112 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.583183 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:53.583338 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.583818 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.584821 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.585208 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.585297 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.585306 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.585483 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.585526 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 10:02:53.585620 18144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.582782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43845 (local address 127.9.127.194:45117)
0811 10:02:53.582928 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:53.582939 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:53.583029 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:53.583188 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:53.583189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:53.583191 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:53.583252 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.583254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.583899 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.583900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.584708 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:53.584710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.585299 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.585300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:53.585394 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.585398 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:53.585474 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 10:02:53.585516 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":1,"thread_start_us":82,"threads_started":1}
I20260811 10:02:53.586004 17748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6833055652db4aa4a322b63ed541939e" candidate_uuid: "2e7757f92d594855ab67edbe5e7a14fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d07e5e0a714a40d8913d6deb159e2a85" is_pre_election: true
I20260811 10:02:53.585980 18048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6833055652db4aa4a322b63ed541939e" candidate_uuid: "2e7757f92d594855ab67edbe5e7a14fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db968ae00ef74e139f64b4c33529b824" is_pre_election: true
I20260811 10:02:53.586165 17748 raft_consensus.cc:2454] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7757f92d594855ab67edbe5e7a14fa in term 0.
I20260811 10:02:53.586165 18048 raft_consensus.cc:2454] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7757f92d594855ab67edbe5e7a14fa in term 0.
I20260811 10:02:53.586437 17830 leader_election.cc:302] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2e7757f92d594855ab67edbe5e7a14fa, d07e5e0a714a40d8913d6deb159e2a85, db968ae00ef74e139f64b4c33529b824; no voters:
I20260811 10:02:53.586591 18141 raft_consensus.cc:2781] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:53.586683 18141 raft_consensus.cc:482] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:53.586716 18141 raft_consensus.cc:3037] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:53.587435 18141 raft_consensus.cc:504] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.587589 18141 leader_election.cc:288] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [CANDIDATE]: Term 1 election: Requested vote from peers db968ae00ef74e139f64b4c33529b824 (127.9.127.195:43845), d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489)
I20260811 10:02:53.587747 18048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6833055652db4aa4a322b63ed541939e" candidate_uuid: "2e7757f92d594855ab67edbe5e7a14fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db968ae00ef74e139f64b4c33529b824"
I20260811 10:02:53.587764 17748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6833055652db4aa4a322b63ed541939e" candidate_uuid: "2e7757f92d594855ab67edbe5e7a14fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d07e5e0a714a40d8913d6deb159e2a85"
I20260811 10:02:53.587836 17748 raft_consensus.cc:3037] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:53.587844 18048 raft_consensus.cc:3037] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:53.588840 17748 raft_consensus.cc:2454] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7757f92d594855ab67edbe5e7a14fa in term 1.
I20260811 10:02:53.588858 18048 raft_consensus.cc:2454] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7757f92d594855ab67edbe5e7a14fa in term 1.
I20260811 10:02:53.589032 17832 leader_election.cc:302] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7757f92d594855ab67edbe5e7a14fa, d07e5e0a714a40d8913d6deb159e2a85; no voters:
I20260811 10:02:53.589140 18141 raft_consensus.cc:2781] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:53.589251 18141 raft_consensus.cc:686] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 1 LEADER]: Becoming Leader. State: Replica: 2e7757f92d594855ab67edbe5e7a14fa, State: Running, Role: LEADER
I20260811 10:02:53.589362 18141 consensus_queue.cc:237] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:53.590204 16739 catalog_manager.cc:5495] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7757f92d594855ab67edbe5e7a14fa (127.9.127.194). New cstate: current_term: 1 leader_uuid: "2e7757f92d594855ab67edbe5e7a14fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:53.590863 17353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: NON_VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: true } } }
I20260811 10:02:53.590975 17353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:53.591604 17353 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: attempting to promote NON_VOTER b6434f7a92a24ac6ae905eb33d1b3815 to VOTER
I20260811 10:02:53.591727 17353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } }
I20260811 10:02:53.592139 17610 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 LEARNER]: Refusing update from remote peer 28671cfc014e42168bd8c2da70aba713: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 10:02:53.592154 17407 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Refusing update from remote peer 28671cfc014e42168bd8c2da70aba713: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 10:02:53.592504 18148 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 10:02:53.592599 18149 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 10:02:53.593288 18119 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:53.593516 17611 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:53.594310 18119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:53.594393 18119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:53.594470 18119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:53.594547 18119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:53.594501 18149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:53.594606 18149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:53.594646 17642 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:53.594635 17407 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:53.594717 17642 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:02:53.595458 18152 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "28671cfc014e42168bd8c2da70aba713" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:53.595582 18152 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:02:53.671227 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.668296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57776 (local address 127.9.127.194:41101)
0811 10:02:53.668367 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.668369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.668379 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:02:53.668491 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.668492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.668514 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.668594 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:53.668752 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.669507 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.670379 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.670604 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.670680 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.670873 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:53.670993 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:53.671090 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.671116 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.671139 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:02:53.673326 17748 raft_consensus.cc:1261] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 1 FOLLOWER]: Refusing update from remote peer 2e7757f92d594855ab67edbe5e7a14fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:53.673364 18048 raft_consensus.cc:1261] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 1 FOLLOWER]: Refusing update from remote peer 2e7757f92d594855ab67edbe5e7a14fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:53.673843 18146 consensus_queue.cc:1035] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:53.674037 18141 consensus_queue.cc:1035] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:53.678229 18155 mvcc.cc:205] Tried to move back new op lower bound from 7317268781762809856 to 7317268781422608384. Current Snapshot: MvccSnapshot[applied={T|T < 7317268781762809856}]
I20260811 10:02:53.680852 16738 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:53.680964 16738 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:53.682466 16738 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 28671cfc014e42168bd8c2da70aba713: Sending DeleteTablet for 3 replicas of tablet 6833055652db4aa4a322b63ed541939e
I20260811 10:02:53.682868 17879 tablet_service.cc:1514] Processing DeleteTablet for tablet 6833055652db4aa4a322b63ed541939e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:53 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:57772
I20260811 10:02:53.682868 18027 tablet_service.cc:1514] Processing DeleteTablet for tablet 6833055652db4aa4a322b63ed541939e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:53 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:36294
I20260811 10:02:53.683254 17727 tablet_service.cc:1514] Processing DeleteTablet for tablet 6833055652db4aa4a322b63ed541939e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:53 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:53250
I20260811 10:02:53.683533 18167 tablet_replica.cc:330] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: stopping tablet replica
I20260811 10:02:53.683614 18164 tablet_replica.cc:330] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: stopping tablet replica
I20260811 10:02:53.683720 18164 raft_consensus.cc:2229] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:53.683735 18167 raft_consensus.cc:2229] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:53.683838 18164 raft_consensus.cc:2258] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:53.683970 18167 raft_consensus.cc:2258] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:53.684420 18164 ts_tablet_manager.cc:1905] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:53.684420 18167 ts_tablet_manager.cc:1905] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:53.684952 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 16702
I20260811 10:02:53.686687 18167 ts_tablet_manager.cc:1918] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:53.686753 18164 ts_tablet_manager.cc:1918] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:53.686820 18164 log.cc:1196] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/6833055652db4aa4a322b63ed541939e
I20260811 10:02:53.686923 18167 log.cc:1196] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/6833055652db4aa4a322b63ed541939e
I20260811 10:02:53.687119 18164 ts_tablet_manager.cc:1939] T 6833055652db4aa4a322b63ed541939e P db968ae00ef74e139f64b4c33529b824: Deleting consensus metadata
I20260811 10:02:53.687338 18167 ts_tablet_manager.cc:1939] T 6833055652db4aa4a322b63ed541939e P d07e5e0a714a40d8913d6deb159e2a85: Deleting consensus metadata
I20260811 10:02:53.693135 18166 tablet_replica.cc:330] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: stopping tablet replica
I20260811 10:02:53.693336 18166 raft_consensus.cc:2229] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:53.693538 18166 raft_consensus.cc:2258] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:53.694109 18166 ts_tablet_manager.cc:1905] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 10:02:53.695869 17676 connection.cc:535] server connection from 127.0.0.1:53250 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 10:02:53.696112 17974 connection.cc:535] server connection from 127.0.0.1:36294 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 10:02:53.697119 18166 ts_tablet_manager.cc:1918] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:53.697269 18166 log.cc:1196] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/6833055652db4aa4a322b63ed541939e
I20260811 10:02:53.697616 18166 ts_tablet_manager.cc:1939] T 6833055652db4aa4a322b63ed541939e P 2e7757f92d594855ab67edbe5e7a14fa: Deleting consensus metadata
W20260811 10:02:53.698064 17832 connection.cc:441] server connection from 127.0.0.1:57772 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57772 (request call id 1) could send its response
I20260811 10:02:53.701869 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.684031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59810 (local address 127.9.127.252:44761)
0811 10:02:53.684070 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.684072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.693010 (+ 8938us) server_negotiation.cc:407] Connection header received
0811 10:02:53.693047 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.693048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.693061 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.693121 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.694435 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.695231 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.696293 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.696598 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.696660 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.698422 (+ 1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.698424 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.698424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.698432 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.700307 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.700710 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.700711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.700712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.700770 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.701014 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.701015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.701016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.701139 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.701231 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.701693 (+ 462us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.701773 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:53.707432 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.698928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59816 (local address 127.9.127.252:44761)
0811 10:02:53.698968 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.698970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.699098 (+ 128us) server_negotiation.cc:407] Connection header received
0811 10:02:53.699205 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.699205 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.699216 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.699246 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.700307 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.701104 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.702375 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.702603 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.702698 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.704391 (+ 1693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.704393 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.704393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.704400 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.706191 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.706611 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.706612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.706613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.706669 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.706871 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.706872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.706872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.707010 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.707091 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.707257 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.707337 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:02:53.707487 18113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:53.698692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40322 (local address 127.9.127.253:38101)
0811 10:02:53.698743 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:53.698745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:53.699035 (+ 290us) server_negotiation.cc:407] Connection header received
0811 10:02:53.699138 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:53.699139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:53.699154 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:53.699183 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:53.700161 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.700965 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.702201 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:53.702529 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:53.702570 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:53.704319 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:53.704321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:53.704321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:53.704329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:53.705933 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.706358 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.706359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.706360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.706418 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:53.706637 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:53.706638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:53.706638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:53.706797 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:53.706915 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:53.707280 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 10:02:53.707365 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:02:54.678411 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:54.678132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.193:40861)
0811 10:02:54.678268 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:54.678352 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
W20260811 10:02:54.678817 17803 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:38819 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
I20260811 10:02:54.679212 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:54.679007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.194:50155)
0811 10:02:54.679094 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:54.679165 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70,"thread_start_us":51,"threads_started":1}
I20260811 10:02:54.679404 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:54.679038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.195:52067)
0811 10:02:54.679154 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:54.679234 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":55,"threads_started":1}
W20260811 10:02:54.679590 18100 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:38819 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
W20260811 10:02:54.679787 17949 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:38819 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
I20260811 10:02:55.182869 18179 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 28671cfc014e42168bd8c2da70aba713)
I20260811 10:02:55.182971 18179 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } }
I20260811 10:02:55.183198 18179 leader_election.cc:288] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28671cfc014e42168bd8c2da70aba713 (127.9.127.254:38819), b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252:44761)
I20260811 10:02:55.183578 18180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.183342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:47386)
0811 10:02:55.183468 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.183543 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
W20260811 10:02:55.183741 17379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
I20260811 10:02:55.184219 18180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.184106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:47402)
0811 10:02:55.184158 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.184188 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 10:02:55.184307 17379 leader_election.cc:334] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 28671cfc014e42168bd8c2da70aba713 (127.9.127.254:38819): Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
I20260811 10:02:55.184352 18184 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 28671cfc014e42168bd8c2da70aba713)
I20260811 10:02:55.184466 18184 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } }
I20260811 10:02:55.184804 18184 leader_election.cc:288] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28671cfc014e42168bd8c2da70aba713 (127.9.127.254:38819), fcc14517fe694ca0af77c3a9e8aff60a (127.9.127.253:38101)
I20260811 10:02:55.185055 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.184889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:47408)
0811 10:02:55.184972 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.185017 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69,"thread_start_us":51,"threads_started":1}
W20260811 10:02:55.185170 17581 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
I20260811 10:02:55.185659 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.185528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:47412)
0811 10:02:55.185583 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.185628 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 10:02:55.185756 17581 leader_election.cc:334] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 28671cfc014e42168bd8c2da70aba713 (127.9.127.254:38819): Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
I20260811 10:02:55.187132 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.183683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59818 (local address 127.9.127.252:44761)
0811 10:02:55.183778 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:55.183780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:55.184000 (+ 220us) server_negotiation.cc:407] Connection header received
0811 10:02:55.184070 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:55.184071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:55.184090 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:55.184172 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:55.184365 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.185179 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.186402 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.186783 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.186872 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.186883 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:55.187034 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 10:02:55.187076 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74,"thread_start_us":44,"threads_started":1}
I20260811 10:02:55.187132 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.183551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:44761 (local address 127.0.0.1:59818)
0811 10:02:55.183928 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.183937 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:55.184013 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:55.184193 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:55.184194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:55.184197 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:55.184275 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.184277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.185282 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.185283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.186311 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.186314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.186876 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.186877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.186938 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.186942 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:55.187026 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 10:02:55.187068 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260811 10:02:55.187335 17611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" is_pre_election: true
I20260811 10:02:55.187451 17611 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcc14517fe694ca0af77c3a9e8aff60a in term 1.
I20260811 10:02:55.187594 17379 leader_election.cc:302] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6434f7a92a24ac6ae905eb33d1b3815, fcc14517fe694ca0af77c3a9e8aff60a; no voters: 28671cfc014e42168bd8c2da70aba713
I20260811 10:02:55.187698 18179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 10:02:55.187757 18179 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 28671cfc014e42168bd8c2da70aba713)
I20260811 10:02:55.187783 18179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 1 FOLLOWER]: Advancing to term 2
I20260811 10:02:55.187968 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.185046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38101 (local address 127.0.0.1:40324)
0811 10:02:55.185108 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.185118 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:55.185166 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:55.185442 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:55.185442 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:55.185445 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:55.185516 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.185517 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.186274 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.186275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.187000 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.187002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.187746 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.187747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.187833 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.187837 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:55.187896 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 10:02:55.187927 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"thread_start_us":56,"threads_started":1}
I20260811 10:02:55.188027 18187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.185116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40324 (local address 127.9.127.253:38101)
0811 10:02:55.185295 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:55.185297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:55.185303 (+ 6us) server_negotiation.cc:407] Connection header received
0811 10:02:55.185327 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:55.185327 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:55.185337 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:55.185429 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:55.185611 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.186188 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.187112 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.187673 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.187749 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.187760 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:55.187912 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 10:02:55.187962 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":156,"thread_start_us":76,"threads_started":1}
I20260811 10:02:55.188295 17407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" is_pre_election: true
I20260811 10:02:55.188638 18179 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } }
I20260811 10:02:55.188817 17407 raft_consensus.cc:2379] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6434f7a92a24ac6ae905eb33d1b3815 in current term 2: Already voted for candidate fcc14517fe694ca0af77c3a9e8aff60a in this term.
I20260811 10:02:55.188827 18179 leader_election.cc:288] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [CANDIDATE]: Term 2 election: Requested vote from peers 28671cfc014e42168bd8c2da70aba713 (127.9.127.254:38819), b6434f7a92a24ac6ae905eb33d1b3815 (127.9.127.252:44761)
I20260811 10:02:55.189043 17581 leader_election.cc:302] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6434f7a92a24ac6ae905eb33d1b3815; no voters: 28671cfc014e42168bd8c2da70aba713, fcc14517fe694ca0af77c3a9e8aff60a
I20260811 10:02:55.189174 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.189070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:47418)
0811 10:02:55.189118 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.189151 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 10:02:55.189168 18184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 1 FOLLOWER]: Advancing to term 2
I20260811 10:02:55.189198 17611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b6434f7a92a24ac6ae905eb33d1b3815"
I20260811 10:02:55.189481 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.189399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:47424)
0811 10:02:55.189441 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.189461 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 10:02:55.189536 17379 leader_election.cc:334] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 28671cfc014e42168bd8c2da70aba713 (127.9.127.254:38819): Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
I20260811 10:02:55.189952 18184 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:02:55.190591 17611 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcc14517fe694ca0af77c3a9e8aff60a in term 2.
I20260811 10:02:55.190737 17379 leader_election.cc:302] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6434f7a92a24ac6ae905eb33d1b3815, fcc14517fe694ca0af77c3a9e8aff60a; no voters: 28671cfc014e42168bd8c2da70aba713
I20260811 10:02:55.190833 18179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 2 FOLLOWER]: Leader election won for term 2
I20260811 10:02:55.190984 18179 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [term 2 LEADER]: Becoming Leader. State: Replica: fcc14517fe694ca0af77c3a9e8aff60a, State: Running, Role: LEADER
I20260811 10:02:55.191092 18179 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } }
I20260811 10:02:55.191452 18189 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcc14517fe694ca0af77c3a9e8aff60a. Latest consensus state: current_term: 2 leader_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:55.191560 18189 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:55.191746 18191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:55.192224 18191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:55.192309 18191 catalog_manager.cc:1259] Loaded cluster ID: 945b4df57bc34993adac2bde4a73cee9
I20260811 10:02:55.192345 18191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:02:55.192508 18191 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:55.192595 18191 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Loaded TSK: 0
I20260811 10:02:55.192755 18191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:02:55.241144 17395 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:55.242949 17395 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:55.244036 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.243930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:47442)
0811 10:02:55.243981 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.244009 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 10:02:55.244063 17611 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [term 2 FOLLOWER]: Refusing update from remote peer fcc14517fe694ca0af77c3a9e8aff60a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 10:02:55.244391 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.244290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.0.0.1:47448)
0811 10:02:55.244340 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.244366 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 10:02:55.244403 18189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 10:02:55.244553 17379 consensus_peers.cc:487] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a -> Peer 28671cfc014e42168bd8c2da70aba713 (127.9.127.254:38819): Couldn't send request to peer 28671cfc014e42168bd8c2da70aba713. Status: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 10:02:55.245149 18184 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcc14517fe694ca0af77c3a9e8aff60a. Latest consensus state: current_term: 2 leader_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:55.245250 18184 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:02:55.245548 18193 mvcc.cc:205] Tried to move back new op lower bound from 7317268788197679104 to 7317268787983388672. Current Snapshot: MvccSnapshot[applied={T|T < 7317268788197679104}]
I20260811 10:02:55.245641 18179 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:55.245738 18179 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:55.245829 18184 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "28671cfc014e42168bd8c2da70aba713" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38819 } } peers { permanent_uuid: "fcc14517fe694ca0af77c3a9e8aff60a" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38101 } attrs { promote: false } } peers { permanent_uuid: "b6434f7a92a24ac6ae905eb33d1b3815" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 44761 } attrs { promote: false } } }
I20260811 10:02:55.245925 18184 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6434f7a92a24ac6ae905eb33d1b3815 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:02:55.250766 18180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.247490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38489 (local address 127.0.0.1:53262)
0811 10:02:55.247610 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.247620 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:55.247711 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:55.247874 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:55.247875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:55.247878 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:55.247950 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.247952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.248693 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.248693 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.249786 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.249789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.250534 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.250535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.250598 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.250602 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:55.250649 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 10:02:55.250696 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":3}
I20260811 10:02:55.250852 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.247428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43845 (local address 127.0.0.1:36306)
0811 10:02:55.247494 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.247504 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:55.247540 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:55.248146 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:55.248146 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:55.248148 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:55.248178 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.248179 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.249102 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.249102 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.249906 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.249908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.250605 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.250605 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.250667 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.250670 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:55.250722 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 10:02:55.250755 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 10:02:55.250857 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.247495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36306 (local address 127.9.127.195:43845)
0811 10:02:55.248021 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:55.248023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:55.248031 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:55.248057 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:55.248058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:55.248067 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:55.248130 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:55.248239 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.249000 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.250014 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.250506 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.250601 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.250612 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:55.250739 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 10:02:55.250779 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":69,"threads_started":1}
I20260811 10:02:55.251155 18027 tablet_service.cc:1467] Processing CreateTablet for tablet 887463243c71479ead203e4c9da10273 (DEFAULT_TABLE table=test-table [id=b06fb2462fed4fbd936eee02bd3a22de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:55.251209 18201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.247429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:41101 (local address 127.0.0.1:57792)
0811 10:02:55.247946 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.247956 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:55.248006 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:55.248199 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:55.248200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:55.248202 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:55.248246 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.248247 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.249111 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.249112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.250177 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.250180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.250979 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.250980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.251037 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.251041 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:55.251104 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 10:02:55.251146 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":163,"thread_start_us":81,"threads_started":1}
I20260811 10:02:55.251240 18202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.247803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57792 (local address 127.9.127.194:41101)
0811 10:02:55.247940 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:55.247942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:55.248060 (+ 118us) server_negotiation.cc:407] Connection header received
0811 10:02:55.248094 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:55.248095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:55.248106 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:55.248158 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:55.248315 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.249028 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.250266 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.250864 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.250934 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.250945 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:55.251124 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 10:02:55.251169 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
I20260811 10:02:55.251291 18027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887463243c71479ead203e4c9da10273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:55.251609 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.247613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53262 (local address 127.9.127.193:38489)
0811 10:02:55.247741 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:55.247743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:55.247751 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:55.247780 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:55.247781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:55.247792 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:55.247860 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:55.248039 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.248610 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.249901 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.250442 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.250522 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.250535 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:55.251498 (+ 963us) server_negotiation.cc:299] Negotiation successful
0811 10:02:55.251546 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260811 10:02:55.251856 17727 tablet_service.cc:1467] Processing CreateTablet for tablet 887463243c71479ead203e4c9da10273 (DEFAULT_TABLE table=test-table [id=b06fb2462fed4fbd936eee02bd3a22de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:55.251982 17727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887463243c71479ead203e4c9da10273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:55.252869 18203 tablet_bootstrap.cc:492] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: Bootstrap starting.
I20260811 10:02:55.252957 17879 tablet_service.cc:1467] Processing CreateTablet for tablet 887463243c71479ead203e4c9da10273 (DEFAULT_TABLE table=test-table [id=b06fb2462fed4fbd936eee02bd3a22de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:55.253113 17879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887463243c71479ead203e4c9da10273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:55.253285 18203 tablet_bootstrap.cc:654] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:55.253439 18204 tablet_bootstrap.cc:492] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85: Bootstrap starting.
I20260811 10:02:55.253815 18204 tablet_bootstrap.cc:654] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:55.253996 18203 tablet_bootstrap.cc:492] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: No bootstrap required, opened a new log
I20260811 10:02:55.254045 18203 ts_tablet_manager.cc:1397] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:55.254182 18203 raft_consensus.cc:348] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.254241 18203 raft_consensus.cc:374] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:55.254259 18203 raft_consensus.cc:729] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db968ae00ef74e139f64b4c33529b824, State: Initialized, Role: FOLLOWER
I20260811 10:02:55.254303 18203 consensus_queue.cc:260] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.254383 18204 tablet_bootstrap.cc:492] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85: No bootstrap required, opened a new log
I20260811 10:02:55.254438 18203 ts_tablet_manager.cc:1428] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:55.254452 18204 ts_tablet_manager.cc:1397] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:55.254624 18204 raft_consensus.cc:348] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.254695 18204 raft_consensus.cc:374] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:55.254719 18204 raft_consensus.cc:729] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d07e5e0a714a40d8913d6deb159e2a85, State: Initialized, Role: FOLLOWER
I20260811 10:02:55.254786 18204 consensus_queue.cc:260] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.254998 18204 ts_tablet_manager.cc:1428] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:55.255157 18101 heartbeater.cc:503] Master 127.9.127.253:38101 was elected leader, sending a full tablet report...
I20260811 10:02:55.255337 18208 tablet_bootstrap.cc:492] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa: Bootstrap starting.
I20260811 10:02:55.255426 18209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.254672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.195:51615)
0811 10:02:55.255359 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.255394 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":75,"threads_started":1}
I20260811 10:02:55.255651 18208 tablet_bootstrap.cc:654] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:55.255788 18209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.255669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.195:37371)
0811 10:02:55.255739 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.255769 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 10:02:55.256016 18211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.255257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.193:35645)
0811 10:02:55.255935 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.255969 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":75,"threads_started":1}
I20260811 10:02:55.256021 17804 heartbeater.cc:503] Master 127.9.127.253:38101 was elected leader, sending a full tablet report...
I20260811 10:02:55.256137 18208 tablet_bootstrap.cc:492] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa: No bootstrap required, opened a new log
I20260811 10:02:55.256183 18208 ts_tablet_manager.cc:1397] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:55.256282 18208 raft_consensus.cc:348] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.256373 18208 raft_consensus.cc:374] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:55.256407 18208 raft_consensus.cc:729] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7757f92d594855ab67edbe5e7a14fa, State: Initialized, Role: FOLLOWER
I20260811 10:02:55.256433 18211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.256298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.193:50137)
0811 10:02:55.256352 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.256409 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 10:02:55.256446 18208 consensus_queue.cc:260] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.256582 18208 ts_tablet_manager.cc:1428] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:55.256968 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.256774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.194:49123)
0811 10:02:55.256910 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.256943 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":101,"threads_started":1}
I20260811 10:02:55.257220 17950 heartbeater.cc:503] Master 127.9.127.253:38101 was elected leader, sending a full tablet report...
I20260811 10:02:55.278714 18207 raft_consensus.cc:482] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:55.278797 18207 raft_consensus.cc:504] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.279079 18207 leader_election.cc:288] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7757f92d594855ab67edbe5e7a14fa (127.9.127.194:41101), d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489)
I20260811 10:02:55.281875 18202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.279234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:55953 (local address 127.9.127.194:41101)
0811 10:02:55.279272 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:55.279274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:55.279284 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:02:55.279427 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:55.279428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:55.279439 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:55.279493 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:55.279646 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.280138 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.281159 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.281504 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.281610 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.281622 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:55.281750 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 10:02:55.281808 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:02:55.281883 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.279294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:38131 (local address 127.9.127.193:38489)
0811 10:02:55.279333 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:55.279335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:55.279449 (+ 114us) server_negotiation.cc:407] Connection header received
0811 10:02:55.279544 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:55.279545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:55.279556 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:55.279627 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:55.279751 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.280161 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.281162 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.281502 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.281610 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.281620 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:55.281784 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 10:02:55.281824 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:55.281932 18215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.279225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38489 (local address 127.9.127.195:38131)
0811 10:02:55.279361 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.279373 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:55.279445 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:55.279648 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:55.279649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:55.279651 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:55.279690 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.279691 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.280268 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.280269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.281071 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.281073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.281632 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.281633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.281690 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.281693 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:55.281767 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 10:02:55.281803 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260811 10:02:55.282143 18209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.279188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:41101 (local address 127.9.127.195:55953)
0811 10:02:55.279229 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.279240 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:55.279295 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:55.279501 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:55.279502 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:55.279505 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:55.279577 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.279579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.280214 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.280215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.281061 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:55.281063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.281609 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.281610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:55.281678 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.281682 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:55.281724 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 10:02:55.281777 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":33}
I20260811 10:02:55.282280 17748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887463243c71479ead203e4c9da10273" candidate_uuid: "db968ae00ef74e139f64b4c33529b824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d07e5e0a714a40d8913d6deb159e2a85" is_pre_election: true
I20260811 10:02:55.282382 17748 raft_consensus.cc:2454] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db968ae00ef74e139f64b4c33529b824 in term 0.
I20260811 10:02:55.282486 17900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887463243c71479ead203e4c9da10273" candidate_uuid: "db968ae00ef74e139f64b4c33529b824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7757f92d594855ab67edbe5e7a14fa" is_pre_election: true
I20260811 10:02:55.282603 17977 leader_election.cc:302] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d07e5e0a714a40d8913d6deb159e2a85, db968ae00ef74e139f64b4c33529b824; no voters:
I20260811 10:02:55.282639 17900 raft_consensus.cc:2454] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db968ae00ef74e139f64b4c33529b824 in term 0.
I20260811 10:02:55.282799 18207 raft_consensus.cc:2781] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:55.282851 18207 raft_consensus.cc:482] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:55.282864 18207 raft_consensus.cc:3037] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:55.283502 18207 raft_consensus.cc:504] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.283641 18207 leader_election.cc:288] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7757f92d594855ab67edbe5e7a14fa (127.9.127.194:41101), d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489)
I20260811 10:02:55.283812 17900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887463243c71479ead203e4c9da10273" candidate_uuid: "db968ae00ef74e139f64b4c33529b824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7757f92d594855ab67edbe5e7a14fa"
I20260811 10:02:55.283870 17900 raft_consensus.cc:3037] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:55.283847 17748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887463243c71479ead203e4c9da10273" candidate_uuid: "db968ae00ef74e139f64b4c33529b824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d07e5e0a714a40d8913d6deb159e2a85"
I20260811 10:02:55.283923 17748 raft_consensus.cc:3037] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:55.284504 17900 raft_consensus.cc:2454] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db968ae00ef74e139f64b4c33529b824 in term 1.
I20260811 10:02:55.284528 17748 raft_consensus.cc:2454] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db968ae00ef74e139f64b4c33529b824 in term 1.
I20260811 10:02:55.284678 17975 leader_election.cc:302] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7757f92d594855ab67edbe5e7a14fa, db968ae00ef74e139f64b4c33529b824; no voters:
I20260811 10:02:55.284759 18207 raft_consensus.cc:2781] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:55.284942 18207 raft_consensus.cc:686] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 1 LEADER]: Becoming Leader. State: Replica: db968ae00ef74e139f64b4c33529b824, State: Running, Role: LEADER
I20260811 10:02:55.285050 18207 consensus_queue.cc:237] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } }
I20260811 10:02:55.285243 18209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.285155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.195:45415)
0811 10:02:55.285189 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.285222 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 10:02:55.285742 17395 catalog_manager.cc:5495] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 reported cstate change: term changed from 0 to 1, leader changed from <none> to db968ae00ef74e139f64b4c33529b824 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "db968ae00ef74e139f64b4c33529b824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db968ae00ef74e139f64b4c33529b824" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:55.295779 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.293477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36320 (local address 127.9.127.195:43845)
0811 10:02:55.293535 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:55.293537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:55.293546 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:55.293628 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:55.293629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:55.293651 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:55.293727 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:55.293852 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.294280 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.295032 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:55.295225 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:55.295289 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:55.295473 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:55.295565 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:55.295671 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:55.295689 (+ 18us) server_negotiation.cc:299] Negotiation successful
0811 10:02:55.295709 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 10:02:55.296751 17748 raft_consensus.cc:1261] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 1 FOLLOWER]: Refusing update from remote peer db968ae00ef74e139f64b4c33529b824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:55.296936 17900 raft_consensus.cc:1261] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 1 FOLLOWER]: Refusing update from remote peer db968ae00ef74e139f64b4c33529b824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:55.297050 18216 consensus_queue.cc:1035] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d07e5e0a714a40d8913d6deb159e2a85" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:55.297219 18207 consensus_queue.cc:1035] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7757f92d594855ab67edbe5e7a14fa" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:55.298405 18220 mvcc.cc:205] Tried to move back new op lower bound from 7317268788413751296 to 7317268788368203776. Current Snapshot: MvccSnapshot[applied={T|T < 7317268788413751296}]
I20260811 10:02:55.298405 18211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.298159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.193:44397)
0811 10:02:55.298338 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.298372 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161}
I20260811 10:02:55.299034 18209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.298897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.195:40665)
0811 10:02:55.298966 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.299006 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 10:02:55.299257 18211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.298969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.193:44609)
0811 10:02:55.299205 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.299232 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220}
I20260811 10:02:55.299505 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.298167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.194:57811)
0811 10:02:55.299462 (+ 1295us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.299486 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1279}
I20260811 10:02:55.300598 18209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.300372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.195:54379)
0811 10:02:55.300544 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.300573 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260811 10:02:55.300536 18222 mvcc.cc:205] Tried to move back new op lower bound from 7317268788413751296 to 7317268788368203776. Current Snapshot: MvccSnapshot[applied={T|T < 7317268788413751296}]
I20260811 10:02:55.301262 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.301118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38819 (local address 127.9.127.194:45095)
0811 10:02:55.301208 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.301238 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 10:02:55.301543 17396 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:55.301623 17396 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:55.302805 17396 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fcc14517fe694ca0af77c3a9e8aff60a: Sending DeleteTablet for 3 replicas of tablet 887463243c71479ead203e4c9da10273
I20260811 10:02:55.303064 17879 tablet_service.cc:1514] Processing DeleteTablet for tablet 887463243c71479ead203e4c9da10273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:55 UTC) from {username='oryx', principal='oryx/127.9.127.253@KRBTEST.COM'} at 127.0.0.1:57792
I20260811 10:02:55.303073 18027 tablet_service.cc:1514] Processing DeleteTablet for tablet 887463243c71479ead203e4c9da10273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:55 UTC) from {username='oryx', principal='oryx/127.9.127.253@KRBTEST.COM'} at 127.0.0.1:36306
I20260811 10:02:55.303171 17727 tablet_service.cc:1514] Processing DeleteTablet for tablet 887463243c71479ead203e4c9da10273 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:55 UTC) from {username='oryx', principal='oryx/127.9.127.253@KRBTEST.COM'} at 127.0.0.1:53262
I20260811 10:02:55.303363 18231 tablet_replica.cc:330] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85: stopping tablet replica
I20260811 10:02:55.303426 18231 raft_consensus.cc:2229] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:55.303467 18231 raft_consensus.cc:2258] T 887463243c71479ead203e4c9da10273 P d07e5e0a714a40d8913d6deb159e2a85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:55.303706 18229 tablet_replica.cc:330] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: stopping tablet replica
I20260811 10:02:55.303769 18229 raft_consensus.cc:2229] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:55.303845 18229 raft_consensus.cc:2258] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:55.303951 18230 tablet_replica.cc:330] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa: stopping tablet replica
I20260811 10:02:55.303957 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 17558
I20260811 10:02:55.305438 18229 ts_tablet_manager.cc:1905] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:55.307560 18229 ts_tablet_manager.cc:1918] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:55.307637 18229 log.cc:1196] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/887463243c71479ead203e4c9da10273
I20260811 10:02:55.307922 18229 ts_tablet_manager.cc:1939] T 887463243c71479ead203e4c9da10273 P db968ae00ef74e139f64b4c33529b824: Deleting consensus metadata
I20260811 10:02:55.304006 18230 raft_consensus.cc:2229] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:55.308203 18230 raft_consensus.cc:2258] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:55.311048 17381 catalog_manager.cc:4841] TS db968ae00ef74e139f64b4c33529b824 (127.9.127.195:43845): tablet 887463243c71479ead203e4c9da10273 (table test-table [id=b06fb2462fed4fbd936eee02bd3a22de]) successfully deleted
W20260811 10:02:55.315027 18201 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:55.314862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38489 (local address 127.0.0.1:53276)
0811 10:02:55.314922 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.314932 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:55.314973 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:38489: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 10:02:55.315120 18230 ts_tablet_manager.cc:1905] T 887463243c71479ead203e4c9da10273 P 2e7757f92d594855ab67edbe5e7a14fa: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 10:02:55.315177 17382 catalog_manager.cc:4584] TS d07e5e0a714a40d8913d6deb159e2a85 (127.9.127.193:38489): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 887463243c71479ead203e4c9da10273: Network error: Client connection negotiation failed: client connection to 127.9.127.193:38489: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260811 10:02:55.315296 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 17811
I20260811 10:02:55.327453 18201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:55.327327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:41101 (local address 127.0.0.1:57806)
0811 10:02:55.327376 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:55.327414 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.194:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 10:02:55.327569 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 17956
I20260811 10:02:55.335666 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 17250
I20260811 10:02:55.342536 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 17456
2026-08-11T10:02:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4927 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:55 dist-test-slave-1x4g krb5kdc[18234](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:55 dist-test-slave-1x4g krb5kdc[18234](info): set up 2 sockets
Aug 11 10:02:55 dist-test-slave-1x4g krb5kdc[18234](info): commencing operation
krb5kdc: starting...
W20260811 10:02:56.401499 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:56 dist-test-slave-1x4g krb5kdc[18234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:56Z Disabled control of system clock
WARNING: no policy specified for oryx/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.254.keytab.
Entry for principal oryx/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.254.keytab.
I20260811 10:02:56.516999 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37095
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.254.keytab
--principal=oryx/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:37095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:56.595158 18248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:56.595355 18248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:56.595377 18248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:56.596565 18248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:56.596608 18248 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 10:02:56.596622 18248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:56.596650 18248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:56.596701 18248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:56.596719 18248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:56.598237 18248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:37095
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.254.keytab
--principal=oryx/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:56.598483 18248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:56.598721 18248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:56.603596 18254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:56.603602 18253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:56.603711 18248 server_base.cc:1034] running on GCE node
W20260811 10:02:56.603705 18256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:56.604064 18248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:56.604334 18248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:56.605492 18248 hybrid_clock.cc:648] HybridClock initialized: now 1786442576605489 us; error 38 us; skew 500 ppm
Aug 11 10:02:56 dist-test-slave-1x4g krb5kdc[18234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442576, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:56.607945 18248 init.cc:377] Logged in from keytab as oryx/127.9.127.254@KRBTEST.COM (short username oryx)
I20260811 10:02:56.608417 18248 webserver.cc:460] Webserver started at http://127.9.127.254:43655/ using document root <none> and password file <none>
I20260811 10:02:56.608651 18248 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:56.608718 18248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:56.608886 18248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:56.609860 18248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "b4a8dbb9b5f7465fa793e58f318e0147"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "d2c71c064cf9f51f8c4986a4ff5bd01b"
server_key_iv: "b911bce6e88bcf12045e525b3d6707a6"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.610277 18248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "b4a8dbb9b5f7465fa793e58f318e0147"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "d2c71c064cf9f51f8c4986a4ff5bd01b"
server_key_iv: "b911bce6e88bcf12045e525b3d6707a6"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.611629 18248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:56.612329 18263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:56.612498 18248 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:56.612605 18248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "b4a8dbb9b5f7465fa793e58f318e0147"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "d2c71c064cf9f51f8c4986a4ff5bd01b"
server_key_iv: "b911bce6e88bcf12045e525b3d6707a6"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.612685 18248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:56.637684 18248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:56.639521 18248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:56.639683 18248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:56.644711 18248 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:37095
I20260811 10:02:56.644763 18333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:37095 every 8 connection(s)
I20260811 10:02:56.645123 18248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:02:56.645720 18334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:56.647915 18334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: Bootstrap starting.
I20260811 10:02:56.648514 18334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:56.648850 18334 log.cc:824] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:56.649507 18334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: No bootstrap required, opened a new log
I20260811 10:02:56.651460 18334 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a8dbb9b5f7465fa793e58f318e0147" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37095 } }
I20260811 10:02:56.651595 18334 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:56.651636 18334 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a8dbb9b5f7465fa793e58f318e0147, State: Initialized, Role: FOLLOWER
I20260811 10:02:56.651690 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 18248
I20260811 10:02:56.651824 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:02:56.651801 18334 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a8dbb9b5f7465fa793e58f318e0147" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37095 } }
I20260811 10:02:56.651911 18334 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:02:56.651952 18334 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:02:56.651995 18334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:56.652053 9727 external_mini_cluster.cc:1428] Setting key f8ed362c66d3df35a663ac8ed571fa31
I20260811 10:02:56.652799 18334 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a8dbb9b5f7465fa793e58f318e0147" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37095 } }
I20260811 10:02:56.652921 18334 leader_election.cc:302] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4a8dbb9b5f7465fa793e58f318e0147; no voters:
I20260811 10:02:56.653069 18334 leader_election.cc:288] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:02:56.653136 18339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:56.653271 18339 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [term 1 LEADER]: Becoming Leader. State: Replica: b4a8dbb9b5f7465fa793e58f318e0147, State: Running, Role: LEADER
I20260811 10:02:56.653326 18334 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:02:56.653383 18339 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a8dbb9b5f7465fa793e58f318e0147" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37095 } }
I20260811 10:02:56.653692 18339 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4a8dbb9b5f7465fa793e58f318e0147. Latest consensus state: current_term: 1 leader_uuid: "b4a8dbb9b5f7465fa793e58f318e0147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a8dbb9b5f7465fa793e58f318e0147" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37095 } } }
I20260811 10:02:56.653781 18339 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:56.653698 18340 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4a8dbb9b5f7465fa793e58f318e0147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a8dbb9b5f7465fa793e58f318e0147" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37095 } } }
I20260811 10:02:56.653918 18340 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147 [sys.catalog]: This master's current role is: LEADER
I20260811 10:02:56.653985 18345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:02:56.654479 18345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:02:56.656014 18345 catalog_manager.cc:1347] Generated new cluster ID: 3056d5536d5c42d08e0ca3121364964a
I20260811 10:02:56.656068 18345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:02:56 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:56.663969 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.652548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.9.127.254:37095)
0811 10:02:56.652767 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:56.652797 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:56.652833 (+ 36us) server_negotiation.cc:407] Connection header received
0811 10:02:56.652976 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:56.652983 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:56.653042 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:56.654031 (+ 989us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:56.654150 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.655748 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.656833 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.657470 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.657583 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.660266 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:56.660270 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:56.660271 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:56.660282 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:56.662339 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.662760 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.662762 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.662763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.662873 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.663099 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.663100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.663100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.663386 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:56.663527 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:56.663650 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 10:02:56.663773 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":96,"threads_started":1}
I20260811 10:02:56.671905 18345 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:02:56.672390 18345 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:02:56.674768 18345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: Generated new TSK 0
I20260811 10:02:56.674929 18345 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab.
Entry for principal oryx/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab.
I20260811 10:02:56.703313 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37095
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab
--principal=oryx/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:56.784540 18361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:56.784732 18361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:56.784755 18361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:56.785872 18361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:56.785913 18361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:56.785933 18361 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:56.785950 18361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:02:56.787344 18361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab
--principal=oryx/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:37095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:56.787549 18361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:56.787720 18361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:56.792479 18367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:56.792614 18369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:56.792717 18361 server_base.cc:1034] running on GCE node
W20260811 10:02:56.792826 18366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:56.793123 18361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:56.793306 18361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:56.794442 18361 hybrid_clock.cc:648] HybridClock initialized: now 1786442576794433 us; error 30 us; skew 500 ppm
Aug 11 10:02:56 dist-test-slave-1x4g krb5kdc[18234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442576, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:56.796965 18361 init.cc:377] Logged in from keytab as oryx/127.9.127.193@KRBTEST.COM (short username oryx)
I20260811 10:02:56.797323 18361 webserver.cc:460] Webserver started at http://127.9.127.193:41113/ using document root <none> and password file <none>
I20260811 10:02:56.797518 18361 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:56.797557 18361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:56.797644 18361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:56.798573 18361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "f012ea578b2841789787372f6e6329d9"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "9a679aeb1ac63649fe1a583ddd86902b"
server_key_iv: "b17c77da04f94420da565cf1cd97a8fe"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.798862 18361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "f012ea578b2841789787372f6e6329d9"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "9a679aeb1ac63649fe1a583ddd86902b"
server_key_iv: "b17c77da04f94420da565cf1cd97a8fe"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.800065 18361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:02:56.800844 18376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:56.801029 18361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:56.801119 18361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "f012ea578b2841789787372f6e6329d9"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "9a679aeb1ac63649fe1a583ddd86902b"
server_key_iv: "b17c77da04f94420da565cf1cd97a8fe"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.801205 18361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:56.810243 18361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:56.811960 18361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:56.812120 18361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:56.812611 18361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:56.812677 18361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:56.812738 18361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:56.812769 18361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 10:02:56 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442576, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:56.820161 18361 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:35705
I20260811 10:02:56.820245 18503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:35705 every 8 connection(s)
I20260811 10:02:56.820572 18361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:02:56.823213 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.813199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:46911 (local address 127.9.127.254:37095)
0811 10:02:56.813263 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:56.813266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:56.813482 (+ 216us) server_negotiation.cc:407] Connection header received
0811 10:02:56.814020 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:56.814021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:56.814043 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:56.814106 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:56.814997 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.815859 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.817509 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.817848 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.817945 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.820573 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:56.820575 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:56.820575 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:56.820584 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:56.822071 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.822467 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.822468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.822468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.822521 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.822701 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.822701 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.822702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.822798 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:56.822861 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:56.823093 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 10:02:56.823156 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:02:56.823416 18388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.813171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37095 (local address 127.9.127.193:46911)
0811 10:02:56.813353 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:56.813396 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:56.813890 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:56.814179 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:56.814183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:56.814572 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:56.814838 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:56.814844 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.815960 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.815961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:56.817399 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:56.817403 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.817967 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.817969 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:56.818136 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.818610 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:56.818621 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:56.820477 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:56.822150 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:56.822157 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:56.822159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:56.822397 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:56.822563 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:56.822564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:56.822564 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:56.822651 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:56.822871 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:56.822877 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:56.822986 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 10:02:56.823069 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 10:02:56.823184 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260811 10:02:56.823942 18504 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37095
I20260811 10:02:56.824031 18504 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:56.824215 18504 heartbeater.cc:511] Master 127.9.127.254:37095 requested a full tablet report, sending...
I20260811 10:02:56.824749 18285 ts_manager.cc:194] Registered new tserver with Master: f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705)
I20260811 10:02:56.825480 18285 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:46911
I20260811 10:02:56.828014 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 18361
I20260811 10:02:56.828143 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:02:56.828433 9727 external_mini_cluster.cc:1428] Setting key b04db0c130ec1c63d4307217f7acba01
I20260811 10:02:56.832901 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.825139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:58837 (local address 127.9.127.254:37095)
0811 10:02:56.825679 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:56.825681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:56.825690 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:56.825711 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:56.825711 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:56.825721 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:56.825783 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:56.826159 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.826618 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.827789 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.828081 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.828162 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.829429 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:56.829431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:56.829431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:56.829439 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:56.831472 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.832008 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.832010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.832010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.832073 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.832290 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.832291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.832291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.832437 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:56.832516 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:56.832693 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 10:02:56.832799 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523}
I20260811 10:02:56.833127 18512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.825074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37095 (local address 127.9.127.193:58837)
0811 10:02:56.825193 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:56.825204 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:56.825257 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:56.825809 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:56.825810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:56.825973 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:56.826051 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:56.826053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.826722 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.826724 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:56.827682 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:56.827685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.828222 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.828223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:56.828298 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.828788 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:56.828793 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:56.829164 (+ 371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:56.831556 (+ 2392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:56.831557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:56.831558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:56.831896 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:56.832158 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:56.832159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:56.832159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:56.832219 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:56.832533 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:56.832534 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:56.832580 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 10:02:56.832666 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 10:02:56.832829 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":68,"threads_started":1}
WARNING: no policy specified for oryx/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab.
Entry for principal oryx/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab.
I20260811 10:02:56.855293 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37095
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab
--principal=oryx/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:56.934101 18515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:56.934273 18515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:56.934293 18515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:56.935284 18515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:56.935316 18515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:56.935336 18515 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:56.935352 18515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:02:56.936715 18515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab
--principal=oryx/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:37095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:56.936904 18515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:56.937067 18515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:56.941679 18520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:56.941695 18521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:56.941831 18515 server_base.cc:1034] running on GCE node
W20260811 10:02:56.941706 18523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:56.942072 18515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:56.942312 18515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:56.943476 18515 hybrid_clock.cc:648] HybridClock initialized: now 1786442576943462 us; error 29 us; skew 500 ppm
Aug 11 10:02:56 dist-test-slave-1x4g krb5kdc[18234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442576, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:56.945951 18515 init.cc:377] Logged in from keytab as oryx/127.9.127.194@KRBTEST.COM (short username oryx)
I20260811 10:02:56.946333 18515 webserver.cc:460] Webserver started at http://127.9.127.194:43697/ using document root <none> and password file <none>
I20260811 10:02:56.946537 18515 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:56.946600 18515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:56.946743 18515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:56.947662 18515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "827a3bbf93b14244b0e46e8031a2ed60"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "f99602ff7cdd7b01403b434c19e170a8"
server_key_iv: "b2592dd465b0545dfd3a5bb385145392"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.947991 18515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "827a3bbf93b14244b0e46e8031a2ed60"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "f99602ff7cdd7b01403b434c19e170a8"
server_key_iv: "b2592dd465b0545dfd3a5bb385145392"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.949385 18515 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:02:56.950101 18531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:56.950289 18515 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:56.950398 18515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "827a3bbf93b14244b0e46e8031a2ed60"
format_stamp: "Formatted at 2026-08-11 10:02:56 on dist-test-slave-1x4g"
server_key: "f99602ff7cdd7b01403b434c19e170a8"
server_key_iv: "b2592dd465b0545dfd3a5bb385145392"
server_key_version: "encryptionkey@0"
I20260811 10:02:56.950490 18515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:56.966171 18515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:56.967964 18515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:56.968123 18515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:56.968618 18515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:56.968677 18515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:56.968719 18515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:56.968740 18515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 10:02:56 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442576, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:56.975924 18515 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:36405
I20260811 10:02:56.976004 18654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:36405 every 8 connection(s)
I20260811 10:02:56.976317 18515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:02:56.979004 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.969177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:50259 (local address 127.9.127.254:37095)
0811 10:02:56.969253 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:56.969256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:56.969433 (+ 177us) server_negotiation.cc:407] Connection header received
0811 10:02:56.969865 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:56.969866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:56.969879 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:56.969963 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:56.970575 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.971408 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.973162 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.973475 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.973566 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.976149 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:56.976150 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:56.976151 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:56.976158 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:56.977605 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.978028 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.978030 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.978030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.978094 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.978347 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.978348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.978348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.978466 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:56.978548 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:56.978815 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 10:02:56.978901 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 10:02:56.979183 18540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.969108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37095 (local address 127.9.127.194:50259)
0811 10:02:56.969337 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:56.969362 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:56.969773 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:56.970035 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:56.970039 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:56.970304 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:56.970480 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:56.970485 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.971530 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.971531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:56.973067 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:56.973072 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.973586 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.973587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:56.973714 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.974640 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:56.974648 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:56.976052 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:56.977691 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:56.977699 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:56.977701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:56.977931 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:56.978166 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:56.978166 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:56.978167 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:56.978273 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:56.978538 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:56.978545 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:56.978680 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 10:02:56.978780 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 10:02:56.978932 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":74,"threads_started":1}
I20260811 10:02:56.979699 18655 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37095
I20260811 10:02:56.979801 18655 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:56.979841 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 18515
I20260811 10:02:56.979969 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:02:56.979979 18655 heartbeater.cc:511] Master 127.9.127.254:37095 requested a full tablet report, sending...
I20260811 10:02:56.980199 9727 external_mini_cluster.cc:1428] Setting key d3bc28d556f7512b6a11696633cb5a82
I20260811 10:02:56.980710 18285 ts_manager.cc:194] Registered new tserver with Master: 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405)
I20260811 10:02:56.981127 18285 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:50259
I20260811 10:02:56.987108 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.980871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:43745 (local address 127.9.127.254:37095)
0811 10:02:56.980925 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:56.980927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:56.981413 (+ 486us) server_negotiation.cc:407] Connection header received
0811 10:02:56.981483 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:56.981483 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:56.981493 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:56.981548 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:56.982005 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.982452 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.983483 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.983770 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.983838 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.984643 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:56.984644 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:56.984644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:56.984650 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:56.986001 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.986390 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.986391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.986391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.986441 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:56.986646 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:56.986647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:56.986647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:56.986772 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:56.986822 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:56.986994 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 10:02:56.987055 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 10:02:56.987219 18662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:56.980696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37095 (local address 127.9.127.194:43745)
0811 10:02:56.981337 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:56.981350 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:56.981426 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:56.981593 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:56.981593 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:56.981833 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:56.981910 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:56.981912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.982555 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.982556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:56.983394 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:56.983397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:56.983842 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:56.983843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:56.983887 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:56.984283 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:56.984287 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:56.984562 (+ 275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:56.986085 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:56.986086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:56.986087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:56.986312 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:56.986508 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:56.986509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:56.986510 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:56.986582 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:56.986837 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:56.986838 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:56.986888 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 10:02:56.986977 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 10:02:56.987100 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for oryx/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab.
Entry for principal oryx/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab.
I20260811 10:02:57.007213 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37095
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab
--principal=oryx/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:57.087141 18666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:57.087316 18666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:57.087337 18666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:57.088289 18666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:57.088320 18666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:57.088338 18666 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 10:02:57.088354 18666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:02:57.089646 18666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab
--principal=oryx/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.9.127.254:37095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:57.089803 18666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:57.089955 18666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:57.094667 18671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:57.094736 18672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:57.094652 18674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:57.094861 18666 server_base.cc:1034] running on GCE node
I20260811 10:02:57.095077 18666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:57.095248 18666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:57.096405 18666 hybrid_clock.cc:648] HybridClock initialized: now 1786442577096394 us; error 28 us; skew 500 ppm
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442577, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:02:57.098870 18666 init.cc:377] Logged in from keytab as oryx/127.9.127.195@KRBTEST.COM (short username oryx)
I20260811 10:02:57.099282 18666 webserver.cc:460] Webserver started at http://127.9.127.195:40829/ using document root <none> and password file <none>
I20260811 10:02:57.099526 18666 fs_manager.cc:359] Metadata directory not provided
I20260811 10:02:57.099566 18666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:02:57.099722 18666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:02:57.100627 18666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "0290928e76dc415d8bd7cf9eaff6e486"
format_stamp: "Formatted at 2026-08-11 10:02:57 on dist-test-slave-1x4g"
server_key: "bb986eb4cd7eeada75d39b64c2ca6aa8"
server_key_iv: "268050b8c7672544122b69a0eff446d0"
server_key_version: "encryptionkey@0"
I20260811 10:02:57.100970 18666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "0290928e76dc415d8bd7cf9eaff6e486"
format_stamp: "Formatted at 2026-08-11 10:02:57 on dist-test-slave-1x4g"
server_key: "bb986eb4cd7eeada75d39b64c2ca6aa8"
server_key_iv: "268050b8c7672544122b69a0eff446d0"
server_key_version: "encryptionkey@0"
I20260811 10:02:57.102242 18666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:57.102947 18682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:57.103108 18666 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:57.103209 18666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "0290928e76dc415d8bd7cf9eaff6e486"
format_stamp: "Formatted at 2026-08-11 10:02:57 on dist-test-slave-1x4g"
server_key: "bb986eb4cd7eeada75d39b64c2ca6aa8"
server_key_iv: "268050b8c7672544122b69a0eff446d0"
server_key_version: "encryptionkey@0"
I20260811 10:02:57.103279 18666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:02:57.110946 18666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:02:57.113175 18666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:02:57.113324 18666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:02:57.113814 18666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:02:57.113896 18666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:57.113937 18666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:02:57.113965 18666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442577, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:57.121037 18666 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:40229
I20260811 10:02:57.121126 18806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:40229 every 8 connection(s)
I20260811 10:02:57.121387 18666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:02:57.122198 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 18666
I20260811 10:02:57.122339 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:02:57.122553 9727 external_mini_cluster.cc:1428] Setting key 91b2449ee754c0f05ff9b14ee8e04082
I20260811 10:02:57.124265 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.114335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:45109 (local address 127.9.127.254:37095)
0811 10:02:57.114406 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.114408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.114546 (+ 138us) server_negotiation.cc:407] Connection header received
0811 10:02:57.115017 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.115019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.115032 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.115081 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:57.115875 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.116738 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.118434 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.118759 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.118827 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.121365 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:57.121366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:57.121367 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:57.121375 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:57.123065 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.123521 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.123522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.123522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.123577 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.123761 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.123762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.123762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.123858 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:57.123903 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.124075 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.124136 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:02:57.124351 18691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.114290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37095 (local address 127.9.127.195:45109)
0811 10:02:57.114434 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.114470 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.114904 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.115154 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.115157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.115515 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:57.115770 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.115777 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.116912 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.116914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.118342 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.118346 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.118846 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.118847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.118998 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.119442 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:57.119454 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:57.121268 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:57.123139 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:57.123147 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:57.123149 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:57.123446 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:57.123621 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:57.123621 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:57.123621 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:57.123710 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:57.123898 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:57.123901 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:57.123994 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.124061 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.124173 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
I20260811 10:02:57.124748 18807 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37095
I20260811 10:02:57.124840 18807 heartbeater.cc:464] Registering TS with master...
I20260811 10:02:57.124989 18807 heartbeater.cc:511] Master 127.9.127.254:37095 requested a full tablet report, sending...
I20260811 10:02:57.125375 18285 ts_manager.cc:194] Registered new tserver with Master: 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229)
I20260811 10:02:57.125810 18285 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:45109
I20260811 10:02:57.130452 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.125815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:54343 (local address 127.9.127.254:37095)
0811 10:02:57.125853 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.125855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.125960 (+ 105us) server_negotiation.cc:407] Connection header received
0811 10:02:57.126022 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.126023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.126033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.126092 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:57.126462 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.126884 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.127517 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.127677 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.127722 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.128405 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:57.128406 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:57.128407 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:57.128412 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:57.129614 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.129918 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.129919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.129919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.129964 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.130127 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.130127 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.130127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.130210 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:57.130256 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.130355 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.130403 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:57.130471 18813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.125717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37095 (local address 127.9.127.195:54343)
0811 10:02:57.125886 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.125896 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.125972 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.126096 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.126097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.126314 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:57.126386 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.126388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.126968 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.126968 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.127448 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.127449 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.127737 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.127738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.127783 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.128094 (+ 311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:57.128098 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:57.128336 (+ 238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:57.129702 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:57.129703 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:57.129703 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:57.129857 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:57.130019 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:57.130020 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:57.130020 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:57.130068 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:57.130259 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:57.130260 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:57.130294 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.130342 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.130410 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":69,"threads_started":1}
I20260811 10:02:57.134186 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442577, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 10:02:57.155949 18338 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:57.150264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34864 (local address 127.9.127.254:37095)
0811 10:02:57.150317 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.150320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.150329 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:57.150395 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.150396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.150411 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.150467 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:57.151018 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.151476 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.152242 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.152430 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.152503 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.155864 (+ 3361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34864: BlockingRecv error: recv got EOF from 127.0.0.1:34864 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442577, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:57.162755 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.156756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34866 (local address 127.9.127.254:37095)
0811 10:02:57.156845 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.156846 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.156919 (+ 73us) server_negotiation.cc:407] Connection header received
0811 10:02:57.156992 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.156994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.157003 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.157052 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:57.157486 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.157971 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.158626 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.158801 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.158870 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.160699 (+ 1829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:57.160700 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:57.160700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:57.160707 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:57.161873 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.162184 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.162185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.162185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.162235 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.162396 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.162396 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.162396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.162489 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:57.162559 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.162646 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.162701 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 10:02:57.164215 18285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:57.165882 18285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:57.172158 18827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.167960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:35705 (local address 127.0.0.1:39282)
0811 10:02:57.168115 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.168153 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.168227 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.168679 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.168680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.168682 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:57.168718 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.168719 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.170054 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.170055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.171136 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.171138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.171815 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.171903 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.171916 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.171996 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.172054 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":28,"thread_start_us":51,"threads_started":1}
I20260811 10:02:57.172240 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.167965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:40229 (local address 127.0.0.1:45104)
0811 10:02:57.168138 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.168163 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.168229 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.168564 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.168566 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.168568 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:57.168632 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.168636 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.170028 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.170029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.170916 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.170919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.171925 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.172002 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.172006 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.172058 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.172113 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":28,"thread_start_us":62,"threads_started":1}
I20260811 10:02:57.172351 18832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.168516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47542 (local address 127.9.127.194:36405)
0811 10:02:57.168699 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.168703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.168712 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:57.168747 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.168749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.168764 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.168889 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:57.169097 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.169757 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171157 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.171884 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171954 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.172023 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.172081 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.172115 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":75,"threads_started":1}
I20260811 10:02:57.172365 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.168172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45104 (local address 127.9.127.195:40229)
0811 10:02:57.168370 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.168375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.168384 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:57.168426 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.168428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.168441 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.168557 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:57.168890 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.169927 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171013 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.171735 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171809 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.171884 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.172200 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.172250 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":86,"threads_started":1}
I20260811 10:02:57.172384 18829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.167966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:36405 (local address 127.0.0.1:47542)
0811 10:02:57.168320 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.168330 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.168368 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.168955 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.168956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.168959 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:57.169017 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.169018 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.169844 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.169845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.171071 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.171074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.171953 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.172012 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.172016 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.172070 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.172104 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":62,"threads_started":1}
I20260811 10:02:57.172816 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.168270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39282 (local address 127.9.127.193:35705)
0811 10:02:57.168442 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.168447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.168459 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:02:57.168525 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.168527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.168543 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.168662 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:57.168830 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.169976 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171199 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.171707 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.171810 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.171886 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.172650 (+ 764us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.172698 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":102,"threads_started":1}
I20260811 10:02:57.173049 18735 tablet_service.cc:1467] Processing CreateTablet for tablet 19fb7443b86142f38b15683bb320fb5b (DEFAULT_TABLE table=test-table [id=debfa35d348d4903897969153239ea56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.173203 18583 tablet_service.cc:1467] Processing CreateTablet for tablet 19fb7443b86142f38b15683bb320fb5b (DEFAULT_TABLE table=test-table [id=debfa35d348d4903897969153239ea56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.173430 18735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19fb7443b86142f38b15683bb320fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.173501 18583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19fb7443b86142f38b15683bb320fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.173478 18428 tablet_service.cc:1467] Processing CreateTablet for tablet 19fb7443b86142f38b15683bb320fb5b (DEFAULT_TABLE table=test-table [id=debfa35d348d4903897969153239ea56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.173728 18428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19fb7443b86142f38b15683bb320fb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.176888 18833 tablet_bootstrap.cc:492] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: Bootstrap starting.
I20260811 10:02:57.177081 18834 tablet_bootstrap.cc:492] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: Bootstrap starting.
I20260811 10:02:57.177435 18835 tablet_bootstrap.cc:492] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: Bootstrap starting.
I20260811 10:02:57.177629 18833 tablet_bootstrap.cc:654] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.177696 18834 tablet_bootstrap.cc:654] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.178030 18835 tablet_bootstrap.cc:654] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.178009 18833 log.cc:824] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:57.178050 18834 log.cc:824] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:57.178395 18835 log.cc:824] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: Log is configured to *not* fsync() on all Append() calls
I20260811 10:02:57.178850 18833 tablet_bootstrap.cc:492] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: No bootstrap required, opened a new log
I20260811 10:02:57.178921 18833 ts_tablet_manager.cc:1397] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:57.179070 18834 tablet_bootstrap.cc:492] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: No bootstrap required, opened a new log
I20260811 10:02:57.179128 18835 tablet_bootstrap.cc:492] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: No bootstrap required, opened a new log
I20260811 10:02:57.179160 18834 ts_tablet_manager.cc:1397] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:57.179178 18835 ts_tablet_manager.cc:1397] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:57.180610 18833 raft_consensus.cc:348] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.180752 18833 raft_consensus.cc:374] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.180812 18833 raft_consensus.cc:729] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f012ea578b2841789787372f6e6329d9, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.180944 18833 consensus_queue.cc:260] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.181105 18835 raft_consensus.cc:348] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.181084 18834 raft_consensus.cc:348] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.181222 18833 ts_tablet_manager.cc:1428] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:02:57.181248 18835 raft_consensus.cc:374] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.181248 18834 raft_consensus.cc:374] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.181290 18834 raft_consensus.cc:729] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0290928e76dc415d8bd7cf9eaff6e486, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.181290 18835 raft_consensus.cc:729] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827a3bbf93b14244b0e46e8031a2ed60, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.181394 18834 consensus_queue.cc:260] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.181394 18835 consensus_queue.cc:260] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.181653 18834 ts_tablet_manager.cc:1428] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:02:57.181653 18835 ts_tablet_manager.cc:1428] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 10:02:57.181722 18807 heartbeater.cc:503] Master 127.9.127.254:37095 was elected leader, sending a full tablet report...
I20260811 10:02:57.181787 18655 heartbeater.cc:503] Master 127.9.127.254:37095 was elected leader, sending a full tablet report...
I20260811 10:02:57.181809 18504 heartbeater.cc:503] Master 127.9.127.254:37095 was elected leader, sending a full tablet report...
I20260811 10:02:57.186668 18840 raft_consensus.cc:482] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:57.186759 18840 raft_consensus.cc:504] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.187057 18840 leader_election.cc:288] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405), f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705)
I20260811 10:02:57.189675 18691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.187196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:35705 (local address 127.9.127.195:44913)
0811 10:02:57.187237 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.187249 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.187290 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.187442 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.187443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.187445 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:57.187507 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.187508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.188073 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.188074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.188838 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.188841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.189416 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.189417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.189504 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.189507 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.189567 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.189610 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 10:02:57.189693 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.187304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:44913 (local address 127.9.127.193:35705)
0811 10:02:57.187346 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.187348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.187355 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:02:57.187375 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.187376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.187385 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.187427 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:57.187595 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.188001 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.188946 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.189334 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.189401 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.189407 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.189585 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.189637 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:02:57.189927 18832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.187367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:50265 (local address 127.9.127.194:36405)
0811 10:02:57.187408 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.187410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.187421 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:02:57.187445 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.187445 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.187454 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.187508 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:57.187663 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.188051 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.189030 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.189557 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.189617 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.189625 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.189812 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.189851 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:57.189955 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.187211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:36405 (local address 127.9.127.195:50265)
0811 10:02:57.187345 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.187354 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.187400 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.187512 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.187513 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.187514 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:57.187601 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.187603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.188128 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.188129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.188934 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.188938 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.189631 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.189632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.189701 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.189706 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.189798 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.189843 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260811 10:02:57.189985 18453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19fb7443b86142f38b15683bb320fb5b" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f012ea578b2841789787372f6e6329d9" is_pre_election: true
I20260811 10:02:57.190099 18453 raft_consensus.cc:2454] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 0.
I20260811 10:02:57.190186 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19fb7443b86142f38b15683bb320fb5b" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60" is_pre_election: true
I20260811 10:02:57.190295 18604 raft_consensus.cc:2454] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 0.
I20260811 10:02:57.190310 18686 leader_election.cc:302] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0290928e76dc415d8bd7cf9eaff6e486, f012ea578b2841789787372f6e6329d9; no voters:
I20260811 10:02:57.190418 18840 raft_consensus.cc:2781] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:57.190474 18840 raft_consensus.cc:482] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:57.190505 18840 raft_consensus.cc:3037] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.191326 18840 raft_consensus.cc:504] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.191463 18840 leader_election.cc:288] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 election: Requested vote from peers 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405), f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705)
I20260811 10:02:57.191622 18453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19fb7443b86142f38b15683bb320fb5b" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f012ea578b2841789787372f6e6329d9"
I20260811 10:02:57.191608 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19fb7443b86142f38b15683bb320fb5b" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60"
I20260811 10:02:57.191687 18604 raft_consensus.cc:3037] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.191687 18453 raft_consensus.cc:3037] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.192541 18453 raft_consensus.cc:2454] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 1.
I20260811 10:02:57.192601 18604 raft_consensus.cc:2454] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 1.
I20260811 10:02:57.192711 18686 leader_election.cc:302] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0290928e76dc415d8bd7cf9eaff6e486, f012ea578b2841789787372f6e6329d9; no voters:
I20260811 10:02:57.192836 18840 raft_consensus.cc:2781] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:57.193017 18840 raft_consensus.cc:686] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 LEADER]: Becoming Leader. State: Replica: 0290928e76dc415d8bd7cf9eaff6e486, State: Running, Role: LEADER
I20260811 10:02:57.193149 18840 consensus_queue.cc:237] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } }
I20260811 10:02:57.193874 18285 catalog_manager.cc:5495] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "0290928e76dc415d8bd7cf9eaff6e486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:57.198702 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.196662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45108 (local address 127.9.127.195:40229)
0811 10:02:57.196716 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.196717 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.196726 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:57.196844 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.196845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.196861 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.196924 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:57.197048 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.197464 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.198127 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.198291 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.198338 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.198473 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.198551 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.198616 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.198650 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.198665 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 10:02:57.200232 18604 raft_consensus.cc:1261] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Refusing update from remote peer 0290928e76dc415d8bd7cf9eaff6e486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.200232 18453 raft_consensus.cc:1261] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Refusing update from remote peer 0290928e76dc415d8bd7cf9eaff6e486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.200526 18840 consensus_queue.cc:1035] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.200681 18843 consensus_queue.cc:1035] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.203094 18846 mvcc.cc:205] Tried to move back new op lower bound from 7317268796209827840 to 7317268796183871488. Current Snapshot: MvccSnapshot[applied={T|T < 7317268796209827840}]
I20260811 10:02:57.203536 18848 mvcc.cc:205] Tried to move back new op lower bound from 7317268796209827840 to 7317268796183871488. Current Snapshot: MvccSnapshot[applied={T|T < 7317268796209827840}]
I20260811 10:02:57.205006 18286 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:57.205085 18286 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:57.205842 18286 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: Sending DeleteTablet for 3 replicas of tablet 19fb7443b86142f38b15683bb320fb5b
I20260811 10:02:57.206106 18735 tablet_service.cc:1514] Processing DeleteTablet for tablet 19fb7443b86142f38b15683bb320fb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:45104
I20260811 10:02:57.206115 18428 tablet_service.cc:1514] Processing DeleteTablet for tablet 19fb7443b86142f38b15683bb320fb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:39282
I20260811 10:02:57.206110 18431 tablet_service.cc:1514] Processing DeleteTablet for tablet 19fb7443b86142f38b15683bb320fb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:39282
I20260811 10:02:57.206187 18583 tablet_service.cc:1514] Processing DeleteTablet for tablet 19fb7443b86142f38b15683bb320fb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:47542
I20260811 10:02:57.206588 18857 tablet_replica.cc:330] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: stopping tablet replica
I20260811 10:02:57.206655 18858 tablet_replica.cc:330] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: stopping tablet replica
I20260811 10:02:57.206605 18286 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 10:02:57.206696 18857 raft_consensus.cc:2229] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:57.206728 18858 raft_consensus.cc:2229] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 10:02:57.206730 18286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:57.206810 18857 raft_consensus.cc:2258] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.206823 18858 raft_consensus.cc:2258] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.207350 18857 ts_tablet_manager.cc:1905] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.207479 18858 ts_tablet_manager.cc:1905] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.208168 18583 tablet_service.cc:1467] Processing CreateTablet for tablet af0c33c061dd4fbf9918b1a015a0fa9e (DEFAULT_TABLE table=test-table [id=7aace3c8523a46d186a953900c1b1117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.208194 18428 tablet_service.cc:1467] Processing CreateTablet for tablet af0c33c061dd4fbf9918b1a015a0fa9e (DEFAULT_TABLE table=test-table [id=7aace3c8523a46d186a953900c1b1117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.208307 18428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af0c33c061dd4fbf9918b1a015a0fa9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.208885 18856 tablet_replica.cc:330] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: stopping tablet replica
I20260811 10:02:57.208985 18857 ts_tablet_manager.cc:1918] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:57.209057 18857 log.cc:1196] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/19fb7443b86142f38b15683bb320fb5b
I20260811 10:02:57.209138 18856 raft_consensus.cc:2229] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:57.209304 18857 ts_tablet_manager.cc:1939] T 19fb7443b86142f38b15683bb320fb5b P f012ea578b2841789787372f6e6329d9: Deleting consensus metadata
I20260811 10:02:57.209591 18856 raft_consensus.cc:2258] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.209707 18833 tablet_bootstrap.cc:492] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: Bootstrap starting.
I20260811 10:02:57.209810 18267 catalog_manager.cc:4841] TS f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705): tablet 19fb7443b86142f38b15683bb320fb5b (table test-table [id=debfa35d348d4903897969153239ea56]) successfully deleted
I20260811 10:02:57.210144 18833 tablet_bootstrap.cc:654] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: Neither blocks nor log segments found. Creating new log.
W20260811 10:02:57.210266 18267 catalog_manager.cc:4808] TS f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705): delete failed for tablet 19fb7443b86142f38b15683bb320fb5b because the tablet was not found. No further retry: Not found: Tablet not found: 19fb7443b86142f38b15683bb320fb5b
I20260811 10:02:57.208920 18735 tablet_service.cc:1467] Processing CreateTablet for tablet af0c33c061dd4fbf9918b1a015a0fa9e (DEFAULT_TABLE table=test-table [id=7aace3c8523a46d186a953900c1b1117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.210610 18735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af0c33c061dd4fbf9918b1a015a0fa9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.210731 18833 tablet_bootstrap.cc:492] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: No bootstrap required, opened a new log
I20260811 10:02:57.210784 18833 ts_tablet_manager.cc:1397] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:57.210879 18856 ts_tablet_manager.cc:1905] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.210934 18833 raft_consensus.cc:348] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.211009 18833 raft_consensus.cc:374] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.211030 18833 raft_consensus.cc:729] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f012ea578b2841789787372f6e6329d9, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.211063 18833 consensus_queue.cc:260] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.211136 18833 ts_tablet_manager.cc:1428] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:57.211923 18834 tablet_bootstrap.cc:492] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: Bootstrap starting.
I20260811 10:02:57.212198 18583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af0c33c061dd4fbf9918b1a015a0fa9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.212369 18834 tablet_bootstrap.cc:654] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.213099 18856 ts_tablet_manager.cc:1918] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:57.213230 18856 log.cc:1196] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/19fb7443b86142f38b15683bb320fb5b
I20260811 10:02:57.213608 18835 tablet_bootstrap.cc:492] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: Bootstrap starting.
I20260811 10:02:57.213901 18856 ts_tablet_manager.cc:1939] T 19fb7443b86142f38b15683bb320fb5b P 0290928e76dc415d8bd7cf9eaff6e486: Deleting consensus metadata
I20260811 10:02:57.213982 18835 tablet_bootstrap.cc:654] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.214290 18858 ts_tablet_manager.cc:1918] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:57.214363 18858 log.cc:1196] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/19fb7443b86142f38b15683bb320fb5b
I20260811 10:02:57.214429 18264 catalog_manager.cc:4841] TS 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229): tablet 19fb7443b86142f38b15683bb320fb5b (table test-table [id=debfa35d348d4903897969153239ea56]) successfully deleted
I20260811 10:02:57.214659 18858 ts_tablet_manager.cc:1939] T 19fb7443b86142f38b15683bb320fb5b P 827a3bbf93b14244b0e46e8031a2ed60: Deleting consensus metadata
I20260811 10:02:57.214793 18835 tablet_bootstrap.cc:492] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: No bootstrap required, opened a new log
I20260811 10:02:57.214839 18835 ts_tablet_manager.cc:1397] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 10:02:57.214977 18835 raft_consensus.cc:348] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.215060 18835 raft_consensus.cc:374] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.215104 18835 raft_consensus.cc:729] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827a3bbf93b14244b0e46e8031a2ed60, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.215147 18835 consensus_queue.cc:260] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.215251 18835 ts_tablet_manager.cc:1428] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:57.215281 18834 tablet_bootstrap.cc:492] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: No bootstrap required, opened a new log
I20260811 10:02:57.215332 18834 ts_tablet_manager.cc:1397] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 10:02:57.215392 18265 catalog_manager.cc:4841] TS 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405): tablet 19fb7443b86142f38b15683bb320fb5b (table test-table [id=debfa35d348d4903897969153239ea56]) successfully deleted
I20260811 10:02:57.215488 18834 raft_consensus.cc:348] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.215566 18834 raft_consensus.cc:374] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.215595 18834 raft_consensus.cc:729] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0290928e76dc415d8bd7cf9eaff6e486, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.215641 18834 consensus_queue.cc:260] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.215729 18834 ts_tablet_manager.cc:1428] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260811 10:02:57.227068 18656 tablet.cc:2369] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:57.249179 18853 raft_consensus.cc:482] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:57.249249 18853 raft_consensus.cc:504] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.249402 18853 leader_election.cc:288] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705), 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405)
I20260811 10:02:57.249588 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af0c33c061dd4fbf9918b1a015a0fa9e" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60" is_pre_election: true
I20260811 10:02:57.249571 18453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af0c33c061dd4fbf9918b1a015a0fa9e" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f012ea578b2841789787372f6e6329d9" is_pre_election: true
I20260811 10:02:57.249662 18453 raft_consensus.cc:2454] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 0.
I20260811 10:02:57.249684 18604 raft_consensus.cc:2454] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 0.
I20260811 10:02:57.249806 18686 leader_election.cc:302] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0290928e76dc415d8bd7cf9eaff6e486, f012ea578b2841789787372f6e6329d9; no voters:
I20260811 10:02:57.249895 18853 raft_consensus.cc:2781] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:57.249927 18853 raft_consensus.cc:482] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:57.249956 18853 raft_consensus.cc:3037] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.250753 18853 raft_consensus.cc:504] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.250875 18853 leader_election.cc:288] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 election: Requested vote from peers f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705), 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405)
I20260811 10:02:57.251048 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af0c33c061dd4fbf9918b1a015a0fa9e" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60"
I20260811 10:02:57.251049 18453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af0c33c061dd4fbf9918b1a015a0fa9e" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f012ea578b2841789787372f6e6329d9"
I20260811 10:02:57.251124 18453 raft_consensus.cc:3037] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.251124 18604 raft_consensus.cc:3037] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.251876 18453 raft_consensus.cc:2454] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 1.
I20260811 10:02:57.251876 18604 raft_consensus.cc:2454] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 1.
I20260811 10:02:57.252040 18686 leader_election.cc:302] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0290928e76dc415d8bd7cf9eaff6e486, f012ea578b2841789787372f6e6329d9; no voters:
I20260811 10:02:57.252130 18853 raft_consensus.cc:2781] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:57.252173 18853 raft_consensus.cc:686] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 LEADER]: Becoming Leader. State: Replica: 0290928e76dc415d8bd7cf9eaff6e486, State: Running, Role: LEADER
I20260811 10:02:57.252213 18853 consensus_queue.cc:237] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.252753 18285 catalog_manager.cc:5495] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "0290928e76dc415d8bd7cf9eaff6e486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } health_report { overall_health: HEALTHY } } }
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442576, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.254@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:57.281121 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.273492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37095 (local address 127.0.0.1:34870)
0811 10:02:57.273678 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.273690 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.273763 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.273915 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.273916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.274318 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:02:57.274377 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.274380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.275001 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.275002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.275840 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.275843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.276160 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.276162 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.276224 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.276810 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:02:57.276816 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:02:57.278382 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:02:57.279833 (+ 1451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:57.279840 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:57.279842 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:57.280116 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:57.280322 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:02:57.280323 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:02:57.280323 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:02:57.280395 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:02:57.280619 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:02:57.280626 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:02:57.280677 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.280801 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.280934 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":106,"threads_started":1}
I20260811 10:02:57.281119 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.273569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34870 (local address 127.9.127.254:37095)
0811 10:02:57.273633 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.273635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.273757 (+ 122us) server_negotiation.cc:407] Connection header received
0811 10:02:57.273821 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.273822 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.273831 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.273878 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:57.274466 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.274911 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.275920 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.276085 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.276131 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.278472 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:57.278474 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:57.278474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:57.278480 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:57.279757 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.280201 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.280202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.280203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.280254 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.280458 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.280458 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.280458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.280552 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:57.280607 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.280844 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.281031 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":37}
I20260811 10:02:57.283114 18286 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:34870:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 10:02:57.283329 18286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:57.284708 18428 tablet_service.cc:1467] Processing CreateTablet for tablet cb4d0b37003d436e8312e64ecc37222a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ab6303b5933d4283b72b36ab908ca051]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:57.284729 18583 tablet_service.cc:1467] Processing CreateTablet for tablet cb4d0b37003d436e8312e64ecc37222a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ab6303b5933d4283b72b36ab908ca051]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:57.284752 18735 tablet_service.cc:1467] Processing CreateTablet for tablet cb4d0b37003d436e8312e64ecc37222a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ab6303b5933d4283b72b36ab908ca051]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 10:02:57.284898 18583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb4d0b37003d436e8312e64ecc37222a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.284897 18735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb4d0b37003d436e8312e64ecc37222a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.284899 18428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb4d0b37003d436e8312e64ecc37222a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.286432 18835 tablet_bootstrap.cc:492] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: Bootstrap starting.
I20260811 10:02:57.286432 18834 tablet_bootstrap.cc:492] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: Bootstrap starting.
I20260811 10:02:57.286561 18833 tablet_bootstrap.cc:492] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: Bootstrap starting.
I20260811 10:02:57.286896 18834 tablet_bootstrap.cc:654] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.286952 18835 tablet_bootstrap.cc:654] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.286990 18833 tablet_bootstrap.cc:654] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.287704 18834 tablet_bootstrap.cc:492] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: No bootstrap required, opened a new log
I20260811 10:02:57.287763 18834 ts_tablet_manager.cc:1397] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:57.287905 18835 tablet_bootstrap.cc:492] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: No bootstrap required, opened a new log
I20260811 10:02:57.287969 18835 ts_tablet_manager.cc:1397] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 10:02:57.288069 18834 raft_consensus.cc:348] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.288152 18834 raft_consensus.cc:374] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.288179 18834 raft_consensus.cc:729] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0290928e76dc415d8bd7cf9eaff6e486, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.288141 18835 raft_consensus.cc:348] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.288203 18835 raft_consensus.cc:374] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.288224 18835 raft_consensus.cc:729] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827a3bbf93b14244b0e46e8031a2ed60, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.288225 18834 consensus_queue.cc:260] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.288271 18833 tablet_bootstrap.cc:492] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: No bootstrap required, opened a new log
I20260811 10:02:57.288266 18835 consensus_queue.cc:260] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.288309 18833 ts_tablet_manager.cc:1397] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:57.288321 18834 ts_tablet_manager.cc:1428] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:57.288349 18835 ts_tablet_manager.cc:1428] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 10:02:57.288427 18853 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.288466 18833 raft_consensus.cc:348] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.288493 18853 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:57.288524 18833 raft_consensus.cc:374] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.288496 18841 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.288551 18833 raft_consensus.cc:729] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f012ea578b2841789787372f6e6329d9, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.288571 18841 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:57.288607 18833 consensus_queue.cc:260] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.288690 18833 ts_tablet_manager.cc:1428] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:57.288740 18839 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.288848 18839 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:57.321079 18839 raft_consensus.cc:482] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:57.321192 18839 raft_consensus.cc:504] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
W20260811 10:02:57.321450 18505 tablet.cc:2369] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:02:57.321534 18839 leader_election.cc:288] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405), 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229)
I20260811 10:02:57.324715 18388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.321769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:36405 (local address 127.9.127.193:58113)
0811 10:02:57.321818 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.321831 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.321877 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.322035 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.322037 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.322039 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:57.322114 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.322116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.322882 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.322884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.323745 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.323748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.324425 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.324426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.324503 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.324507 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.324590 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.324629 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":39}
I20260811 10:02:57.324760 18832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.321875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:58113 (local address 127.9.127.194:36405)
0811 10:02:57.321918 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.321921 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.321930 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:57.321955 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.321956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.321965 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.322016 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:57.322227 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.322787 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.323830 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.324358 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.324410 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.324417 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.324606 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.324650 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:57.325023 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb4d0b37003d436e8312e64ecc37222a" candidate_uuid: "f012ea578b2841789787372f6e6329d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60" is_pre_election: true
I20260811 10:02:57.325135 18604 raft_consensus.cc:2454] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f012ea578b2841789787372f6e6329d9 in term 0.
I20260811 10:02:57.325249 18872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.321821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:40229 (local address 127.9.127.193:45855)
0811 10:02:57.322021 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.322031 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.322103 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.322245 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.322246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.322249 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:02:57.322328 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.322329 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.322961 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.322962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.324233 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.324236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.324994 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.324995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.325068 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.325074 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.325134 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.325173 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":80,"threads_started":1}
I20260811 10:02:57.325273 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.321989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:45855 (local address 127.9.127.195:40229)
0811 10:02:57.322090 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.322093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.322101 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:57.322164 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.322165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.322177 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.322231 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:02:57.322399 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.322873 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.324317 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.324907 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.324980 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.324989 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.325157 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.325198 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 10:02:57.325321 18379 leader_election.cc:302] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 827a3bbf93b14244b0e46e8031a2ed60, f012ea578b2841789787372f6e6329d9; no voters:
I20260811 10:02:57.325456 18839 raft_consensus.cc:2781] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:57.325497 18839 raft_consensus.cc:482] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:57.325521 18839 raft_consensus.cc:3037] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.325492 18758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb4d0b37003d436e8312e64ecc37222a" candidate_uuid: "f012ea578b2841789787372f6e6329d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0290928e76dc415d8bd7cf9eaff6e486" is_pre_election: true
I20260811 10:02:57.325596 18758 raft_consensus.cc:2454] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f012ea578b2841789787372f6e6329d9 in term 0.
I20260811 10:02:57.326241 18839 raft_consensus.cc:504] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.326390 18839 leader_election.cc:288] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [CANDIDATE]: Term 1 election: Requested vote from peers 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405), 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229)
I20260811 10:02:57.326548 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb4d0b37003d436e8312e64ecc37222a" candidate_uuid: "f012ea578b2841789787372f6e6329d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60"
I20260811 10:02:57.326653 18604 raft_consensus.cc:3037] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.326596 18758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb4d0b37003d436e8312e64ecc37222a" candidate_uuid: "f012ea578b2841789787372f6e6329d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0290928e76dc415d8bd7cf9eaff6e486"
I20260811 10:02:57.326689 18758 raft_consensus.cc:3037] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.327217 18604 raft_consensus.cc:2454] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f012ea578b2841789787372f6e6329d9 in term 1.
I20260811 10:02:57.327322 18758 raft_consensus.cc:2454] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f012ea578b2841789787372f6e6329d9 in term 1.
I20260811 10:02:57.327392 18379 leader_election.cc:302] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 827a3bbf93b14244b0e46e8031a2ed60, f012ea578b2841789787372f6e6329d9; no voters:
I20260811 10:02:57.327488 18839 raft_consensus.cc:2781] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:57.327687 18839 raft_consensus.cc:686] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [term 1 LEADER]: Becoming Leader. State: Replica: f012ea578b2841789787372f6e6329d9, State: Running, Role: LEADER
I20260811 10:02:57.327775 18839 consensus_queue.cc:237] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.328120 18873 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: TxnStatusTablet state changed. Reason: New leader f012ea578b2841789787372f6e6329d9. Latest consensus state: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.328205 18873 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:57.328435 18875 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 10:02:57.328444 18286 catalog_manager.cc:5495] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f012ea578b2841789787372f6e6329d9 (127.9.127.193). New cstate: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:57.328536 18875 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 10:02:57.336361 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.333770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:35705 (local address 127.0.0.1:39290)
0811 10:02:57.333839 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.333850 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.333912 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.334065 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.334066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.334066 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:57.334105 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.334107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.334938 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.334938 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.335482 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.335483 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.335895 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.335896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.335941 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.335955 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.336241 (+ 286us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.336247 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.336279 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.336313 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 10:02:57.336359 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.333822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39290 (local address 127.9.127.193:35705)
0811 10:02:57.333859 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.333861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.333886 (+ 25us) server_negotiation.cc:407] Connection header received
0811 10:02:57.333970 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.333971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.333988 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.334066 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:57.334141 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.334843 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.335558 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.335821 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.335889 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.336055 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.336165 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.336248 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.336285 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.336301 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:02:57.337442 18758 raft_consensus.cc:1261] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Refusing update from remote peer f012ea578b2841789787372f6e6329d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.337435 18604 raft_consensus.cc:1261] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Refusing update from remote peer f012ea578b2841789787372f6e6329d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.337693 18839 consensus_queue.cc:1035] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.337831 18873 consensus_queue.cc:1035] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.338456 18841 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: TxnStatusTablet state changed. Reason: New leader f012ea578b2841789787372f6e6329d9. Latest consensus state: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.338538 18841 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:57.338897 18853 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: TxnStatusTablet state changed. Reason: New leader f012ea578b2841789787372f6e6329d9. Latest consensus state: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.338990 18853 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:57.339416 18839 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.339504 18839 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:57.339579 18847 mvcc.cc:205] Tried to move back new op lower bound from 7317268796772212736 to 7317268796735164416. Current Snapshot: MvccSnapshot[applied={T|T < 7317268796772212736}]
I20260811 10:02:57.339903 18853 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.339984 18853 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P 0290928e76dc415d8bd7cf9eaff6e486: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:57.340369 18881 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.340440 18881 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P f012ea578b2841789787372f6e6329d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 10:02:57.340626 18841 tablet_replica.cc:439] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } } }
I20260811 10:02:57.340696 18841 tablet_replica.cc:442] T cb4d0b37003d436e8312e64ecc37222a P 827a3bbf93b14244b0e46e8031a2ed60: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 10:02:57.345389 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.343112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:57407 (local address 127.9.127.193:35705)
0811 10:02:57.343144 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.343146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.343154 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:57.343206 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.343206 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.343214 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.343275 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:57.343338 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.343965 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.344599 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.344837 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.344892 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.345052 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.345095 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.345250 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.345314 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.345333 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 10:02:57.345413 18813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.343049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:35705 (local address 127.9.127.195:57407)
0811 10:02:57.343117 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.343127 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.343168 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.343277 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.343277 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.343278 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:57.343306 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.343307 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.344028 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.344029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.344498 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.344499 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.344905 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.344907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.344961 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.344974 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.345255 (+ 281us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.345257 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.345300 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.345347 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 10:02:57.347254 18453 raft_consensus.cc:1261] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Refusing update from remote peer 0290928e76dc415d8bd7cf9eaff6e486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.347265 18604 raft_consensus.cc:1261] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Refusing update from remote peer 0290928e76dc415d8bd7cf9eaff6e486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.347452 18853 consensus_queue.cc:1035] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.347514 18840 consensus_queue.cc:1035] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.355722 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.353105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:36561 (local address 127.9.127.195:40229)
0811 10:02:57.353192 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.353194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.353261 (+ 67us) server_negotiation.cc:407] Connection header received
0811 10:02:57.353346 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.353347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.353356 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.353402 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:57.353533 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.353972 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.355006 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.355211 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.355280 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.355482 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.355513 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.355561 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.355620 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.355635 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 10:02:57.355749 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.353051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:40229 (local address 127.9.127.193:36561)
0811 10:02:57.353197 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.353207 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.353286 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.353406 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.353407 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.353408 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:57.353464 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.353465 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.354036 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.354037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.354900 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.354903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.355314 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.355315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.355381 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.355396 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.355570 (+ 174us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.355572 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.355618 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.355654 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":87,"threads_started":1}
I20260811 10:02:57.364496 18286 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:57.364568 18286 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:57.365224 18286 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: Sending DeleteTablet for 3 replicas of tablet af0c33c061dd4fbf9918b1a015a0fa9e
I20260811 10:02:57.365465 18428 tablet_service.cc:1514] Processing DeleteTablet for tablet af0c33c061dd4fbf9918b1a015a0fa9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:39282
I20260811 10:02:57.365502 18583 tablet_service.cc:1514] Processing DeleteTablet for tablet af0c33c061dd4fbf9918b1a015a0fa9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:47542
I20260811 10:02:57.365548 18857 tablet_replica.cc:330] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: stopping tablet replica
I20260811 10:02:57.365579 18858 tablet_replica.cc:330] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: stopping tablet replica
I20260811 10:02:57.365604 18857 raft_consensus.cc:2229] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:57.365617 18858 raft_consensus.cc:2229] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:57.365645 18858 raft_consensus.cc:2258] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.365645 18857 raft_consensus.cc:2258] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.365768 18735 tablet_service.cc:1514] Processing DeleteTablet for tablet af0c33c061dd4fbf9918b1a015a0fa9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:45104
I20260811 10:02:57.365869 18856 tablet_replica.cc:330] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: stopping tablet replica
I20260811 10:02:57.365938 18856 raft_consensus.cc:2229] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:57.366003 18856 raft_consensus.cc:2258] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.366063 18857 ts_tablet_manager.cc:1905] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.366063 18858 ts_tablet_manager.cc:1905] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.366279 18856 ts_tablet_manager.cc:1905] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.369789 18858 ts_tablet_manager.cc:1918] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:57.369865 18858 log.cc:1196] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/af0c33c061dd4fbf9918b1a015a0fa9e
I20260811 10:02:57.370070 18858 ts_tablet_manager.cc:1939] T af0c33c061dd4fbf9918b1a015a0fa9e P 827a3bbf93b14244b0e46e8031a2ed60: Deleting consensus metadata
I20260811 10:02:57.370327 18856 ts_tablet_manager.cc:1918] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:57.370378 18856 log.cc:1196] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/af0c33c061dd4fbf9918b1a015a0fa9e
I20260811 10:02:57.370368 18265 catalog_manager.cc:4841] TS 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405): tablet af0c33c061dd4fbf9918b1a015a0fa9e (table test-table [id=7aace3c8523a46d186a953900c1b1117]) successfully deleted
I20260811 10:02:57.370584 18856 ts_tablet_manager.cc:1939] T af0c33c061dd4fbf9918b1a015a0fa9e P 0290928e76dc415d8bd7cf9eaff6e486: Deleting consensus metadata
I20260811 10:02:57.370849 18857 ts_tablet_manager.cc:1918] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:57.370910 18857 log.cc:1196] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/af0c33c061dd4fbf9918b1a015a0fa9e
I20260811 10:02:57.370883 18264 catalog_manager.cc:4841] TS 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229): tablet af0c33c061dd4fbf9918b1a015a0fa9e (table test-table [id=7aace3c8523a46d186a953900c1b1117]) successfully deleted
I20260811 10:02:57.371110 18857 ts_tablet_manager.cc:1939] T af0c33c061dd4fbf9918b1a015a0fa9e P f012ea578b2841789787372f6e6329d9: Deleting consensus metadata
I20260811 10:02:57.371480 18267 catalog_manager.cc:4841] TS f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705): tablet af0c33c061dd4fbf9918b1a015a0fa9e (table test-table [id=7aace3c8523a46d186a953900c1b1117]) successfully deleted
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 10:02:57.394819 18338 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:02:57.389335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34876 (local address 127.9.127.254:37095)
0811 10:02:57.389400 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.389403 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.389501 (+ 98us) server_negotiation.cc:407] Connection header received
0811 10:02:57.389582 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.389582 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.389607 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.389665 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:57.390227 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.390694 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.391474 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.391658 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.391765 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.394753 (+ 2988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34876: BlockingRecv error: recv got EOF from 127.0.0.1:34876 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM
I20260811 10:02:57.402523 18338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.395823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34892 (local address 127.9.127.254:37095)
0811 10:02:57.395877 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.395879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.395931 (+ 52us) server_negotiation.cc:407] Connection header received
0811 10:02:57.396012 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.396013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.396022 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.396112 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:02:57.396544 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.397126 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.397866 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.398064 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.398143 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.400161 (+ 2018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:02:57.400162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:02:57.400163 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:02:57.400169 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:02:57.401423 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.401771 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.401772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.401773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.401831 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:02:57.402030 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:02:57.402031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:02:57.402032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:02:57.402145 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:02:57.402247 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.402356 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.402430 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 10:02:57.404029 18286 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:57.404201 18286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:57.405649 18428 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1c2dd6725b48609463deae016f4702 (DEFAULT_TABLE table=test-table [id=38ef322367d447c1a3e26f1cd6727877]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.405707 18735 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1c2dd6725b48609463deae016f4702 (DEFAULT_TABLE table=test-table [id=38ef322367d447c1a3e26f1cd6727877]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.405788 18428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1c2dd6725b48609463deae016f4702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.405824 18735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1c2dd6725b48609463deae016f4702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.407171 18833 tablet_bootstrap.cc:492] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: Bootstrap starting.
I20260811 10:02:57.407204 18583 tablet_service.cc:1467] Processing CreateTablet for tablet 3e1c2dd6725b48609463deae016f4702 (DEFAULT_TABLE table=test-table [id=38ef322367d447c1a3e26f1cd6727877]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.407327 18583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e1c2dd6725b48609463deae016f4702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.407503 18833 tablet_bootstrap.cc:654] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.408051 18833 tablet_bootstrap.cc:492] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: No bootstrap required, opened a new log
I20260811 10:02:57.408103 18833 ts_tablet_manager.cc:1397] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:57.408236 18833 raft_consensus.cc:348] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.408320 18833 raft_consensus.cc:374] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.408340 18833 raft_consensus.cc:729] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f012ea578b2841789787372f6e6329d9, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.408380 18833 consensus_queue.cc:260] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.408458 18833 ts_tablet_manager.cc:1428] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:57.408691 18835 tablet_bootstrap.cc:492] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: Bootstrap starting.
I20260811 10:02:57.408725 18834 tablet_bootstrap.cc:492] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: Bootstrap starting.
I20260811 10:02:57.409201 18834 tablet_bootstrap.cc:654] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.409334 18835 tablet_bootstrap.cc:654] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.409878 18834 tablet_bootstrap.cc:492] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: No bootstrap required, opened a new log
I20260811 10:02:57.409945 18834 ts_tablet_manager.cc:1397] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:57.410059 18834 raft_consensus.cc:348] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.410148 18834 raft_consensus.cc:374] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.410176 18834 raft_consensus.cc:729] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0290928e76dc415d8bd7cf9eaff6e486, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.410177 18835 tablet_bootstrap.cc:492] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: No bootstrap required, opened a new log
I20260811 10:02:57.410229 18835 ts_tablet_manager.cc:1397] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:57.410218 18834 consensus_queue.cc:260] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.410315 18834 ts_tablet_manager.cc:1428] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:57.410386 18835 raft_consensus.cc:348] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.410470 18835 raft_consensus.cc:374] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.410491 18835 raft_consensus.cc:729] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827a3bbf93b14244b0e46e8031a2ed60, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.410530 18835 consensus_queue.cc:260] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.410636 18835 ts_tablet_manager.cc:1428] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:57.433156 18840 raft_consensus.cc:482] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:57.433238 18840 raft_consensus.cc:504] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.433423 18840 leader_election.cc:288] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705), 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405)
I20260811 10:02:57.433574 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e1c2dd6725b48609463deae016f4702" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60" is_pre_election: true
I20260811 10:02:57.433574 18453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e1c2dd6725b48609463deae016f4702" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f012ea578b2841789787372f6e6329d9" is_pre_election: true
I20260811 10:02:57.433676 18453 raft_consensus.cc:2454] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 0.
I20260811 10:02:57.433676 18604 raft_consensus.cc:2454] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 0.
I20260811 10:02:57.433840 18684 leader_election.cc:302] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0290928e76dc415d8bd7cf9eaff6e486, 827a3bbf93b14244b0e46e8031a2ed60; no voters:
I20260811 10:02:57.433955 18840 raft_consensus.cc:2781] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:57.433988 18840 raft_consensus.cc:482] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:57.434015 18840 raft_consensus.cc:3037] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.434568 18840 raft_consensus.cc:504] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.434710 18840 leader_election.cc:288] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 election: Requested vote from peers f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705), 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405)
I20260811 10:02:57.434901 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e1c2dd6725b48609463deae016f4702" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60"
I20260811 10:02:57.434906 18453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e1c2dd6725b48609463deae016f4702" candidate_uuid: "0290928e76dc415d8bd7cf9eaff6e486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f012ea578b2841789787372f6e6329d9"
I20260811 10:02:57.434975 18604 raft_consensus.cc:3037] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.434978 18453 raft_consensus.cc:3037] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.435525 18604 raft_consensus.cc:2454] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 1.
I20260811 10:02:57.436101 18453 raft_consensus.cc:2454] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0290928e76dc415d8bd7cf9eaff6e486 in term 1.
I20260811 10:02:57.436354 18684 leader_election.cc:302] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0290928e76dc415d8bd7cf9eaff6e486, 827a3bbf93b14244b0e46e8031a2ed60; no voters:
I20260811 10:02:57.436461 18840 raft_consensus.cc:2781] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:57.436510 18840 raft_consensus.cc:686] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 LEADER]: Becoming Leader. State: Replica: 0290928e76dc415d8bd7cf9eaff6e486, State: Running, Role: LEADER
I20260811 10:02:57.436560 18840 consensus_queue.cc:237] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.437450 18283 catalog_manager.cc:5495] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "0290928e76dc415d8bd7cf9eaff6e486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } health_report { overall_health: HEALTHY } } }
I20260811 10:02:57.449477 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.447116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45120 (local address 127.9.127.195:40229)
0811 10:02:57.447165 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.447167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.447177 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:02:57.447241 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.447242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.447253 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.447295 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:57.447413 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.447829 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.448846 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.449055 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.449101 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.449289 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.449314 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.449345 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.449418 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.449435 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 10:02:57.450152 18453 raft_consensus.cc:1261] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Refusing update from remote peer 0290928e76dc415d8bd7cf9eaff6e486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.450251 18604 raft_consensus.cc:1261] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Refusing update from remote peer 0290928e76dc415d8bd7cf9eaff6e486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.450467 18853 consensus_queue.cc:1035] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.450553 18840 consensus_queue.cc:1035] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.452989 18285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:57.453071 18285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:57.453778 18285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: Sending DeleteTablet for 3 replicas of tablet 3e1c2dd6725b48609463deae016f4702
I20260811 10:02:57.453995 18428 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1c2dd6725b48609463deae016f4702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:39282
I20260811 10:02:57.454020 18583 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1c2dd6725b48609463deae016f4702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:47542
I20260811 10:02:57.454100 18431 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1c2dd6725b48609463deae016f4702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:39282
I20260811 10:02:57.454102 18735 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e1c2dd6725b48609463deae016f4702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:45104
I20260811 10:02:57.454157 18857 tablet_replica.cc:330] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: stopping tablet replica
I20260811 10:02:57.454175 18858 tablet_replica.cc:330] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: stopping tablet replica
I20260811 10:02:57.454216 18858 raft_consensus.cc:2229] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:57.454203 18857 raft_consensus.cc:2229] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:57.454257 18858 raft_consensus.cc:2258] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.454262 18857 raft_consensus.cc:2258] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.454331 18856 tablet_replica.cc:330] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: stopping tablet replica
I20260811 10:02:57.454382 18856 raft_consensus.cc:2229] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:57.454430 18856 raft_consensus.cc:2258] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.454666 18286 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:02:57.454811 18286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:02:57.454882 18856 ts_tablet_manager.cc:1905] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.455331 18858 ts_tablet_manager.cc:1905] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.455971 18583 tablet_service.cc:1467] Processing CreateTablet for tablet 188418efbc284cdb9c0fed459c0fab13 (DEFAULT_TABLE table=test-table [id=6f7ab67a907f4941b7fc4c153ad6a83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.456140 18583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 188418efbc284cdb9c0fed459c0fab13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.456455 18856 ts_tablet_manager.cc:1918] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:57.456511 18856 log.cc:1196] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/3e1c2dd6725b48609463deae016f4702
I20260811 10:02:57.456745 18856 ts_tablet_manager.cc:1939] T 3e1c2dd6725b48609463deae016f4702 P 0290928e76dc415d8bd7cf9eaff6e486: Deleting consensus metadata
I20260811 10:02:57.457082 18858 ts_tablet_manager.cc:1918] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:57.457139 18858 log.cc:1196] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/3e1c2dd6725b48609463deae016f4702
I20260811 10:02:57.457330 18858 ts_tablet_manager.cc:1939] T 3e1c2dd6725b48609463deae016f4702 P 827a3bbf93b14244b0e46e8031a2ed60: Deleting consensus metadata
I20260811 10:02:57.457439 18835 tablet_bootstrap.cc:492] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: Bootstrap starting.
I20260811 10:02:57.457583 18265 catalog_manager.cc:4841] TS 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405): tablet 3e1c2dd6725b48609463deae016f4702 (table test-table [id=38ef322367d447c1a3e26f1cd6727877]) successfully deleted
I20260811 10:02:57.457782 18431 tablet_service.cc:1467] Processing CreateTablet for tablet 188418efbc284cdb9c0fed459c0fab13 (DEFAULT_TABLE table=test-table [id=6f7ab67a907f4941b7fc4c153ad6a83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.457818 18835 tablet_bootstrap.cc:654] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.457816 18857 ts_tablet_manager.cc:1905] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.457890 18431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 188418efbc284cdb9c0fed459c0fab13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.458989 18857 ts_tablet_manager.cc:1918] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:02:57.459070 18857 log.cc:1196] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/3e1c2dd6725b48609463deae016f4702
I20260811 10:02:57.459261 18857 ts_tablet_manager.cc:1939] T 3e1c2dd6725b48609463deae016f4702 P f012ea578b2841789787372f6e6329d9: Deleting consensus metadata
I20260811 10:02:57.459569 18267 catalog_manager.cc:4841] TS f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705): tablet 3e1c2dd6725b48609463deae016f4702 (table test-table [id=38ef322367d447c1a3e26f1cd6727877]) successfully deleted
I20260811 10:02:57.459610 18264 catalog_manager.cc:4841] TS 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229): tablet 3e1c2dd6725b48609463deae016f4702 (table test-table [id=38ef322367d447c1a3e26f1cd6727877]) successfully deleted
W20260811 10:02:57.459651 18267 catalog_manager.cc:4808] TS f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705): delete failed for tablet 3e1c2dd6725b48609463deae016f4702 because the tablet was not found. No further retry: Not found: Tablet not found: 3e1c2dd6725b48609463deae016f4702
I20260811 10:02:57.459764 18735 tablet_service.cc:1467] Processing CreateTablet for tablet 188418efbc284cdb9c0fed459c0fab13 (DEFAULT_TABLE table=test-table [id=6f7ab67a907f4941b7fc4c153ad6a83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:02:57.459872 18735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 188418efbc284cdb9c0fed459c0fab13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:02:57.460922 18833 tablet_bootstrap.cc:492] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9: Bootstrap starting.
I20260811 10:02:57.461035 18834 tablet_bootstrap.cc:492] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: Bootstrap starting.
I20260811 10:02:57.461333 18833 tablet_bootstrap.cc:654] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.461333 18834 tablet_bootstrap.cc:654] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: Neither blocks nor log segments found. Creating new log.
I20260811 10:02:57.461961 18834 tablet_bootstrap.cc:492] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: No bootstrap required, opened a new log
I20260811 10:02:57.462025 18834 ts_tablet_manager.cc:1397] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 10:02:57.462051 18835 tablet_bootstrap.cc:492] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: No bootstrap required, opened a new log
I20260811 10:02:57.462096 18835 ts_tablet_manager.cc:1397] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 10:02:57.462143 18834 raft_consensus.cc:348] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.462216 18834 raft_consensus.cc:374] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.462242 18834 raft_consensus.cc:729] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0290928e76dc415d8bd7cf9eaff6e486, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.462248 18835 raft_consensus.cc:348] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.462292 18834 consensus_queue.cc:260] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.462321 18835 raft_consensus.cc:374] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.462344 18835 raft_consensus.cc:729] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827a3bbf93b14244b0e46e8031a2ed60, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.462385 18834 ts_tablet_manager.cc:1428] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:57.462385 18835 consensus_queue.cc:260] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.462479 18835 ts_tablet_manager.cc:1428] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 10:02:57.463137 18833 tablet_bootstrap.cc:492] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9: No bootstrap required, opened a new log
I20260811 10:02:57.463192 18833 ts_tablet_manager.cc:1397] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:02:57.463323 18833 raft_consensus.cc:348] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.463405 18833 raft_consensus.cc:374] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:02:57.463433 18833 raft_consensus.cc:729] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f012ea578b2841789787372f6e6329d9, State: Initialized, Role: FOLLOWER
I20260811 10:02:57.463495 18833 consensus_queue.cc:260] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.463585 18833 ts_tablet_manager.cc:1428] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 10:02:57.572981 18880 raft_consensus.cc:482] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:02:57.573086 18880 raft_consensus.cc:504] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.573276 18880 leader_election.cc:288] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405), 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229)
I20260811 10:02:57.573535 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "188418efbc284cdb9c0fed459c0fab13" candidate_uuid: "f012ea578b2841789787372f6e6329d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60" is_pre_election: true
I20260811 10:02:57.573534 18758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "188418efbc284cdb9c0fed459c0fab13" candidate_uuid: "f012ea578b2841789787372f6e6329d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0290928e76dc415d8bd7cf9eaff6e486" is_pre_election: true
I20260811 10:02:57.573652 18604 raft_consensus.cc:2454] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f012ea578b2841789787372f6e6329d9 in term 0.
I20260811 10:02:57.573665 18758 raft_consensus.cc:2454] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f012ea578b2841789787372f6e6329d9 in term 0.
I20260811 10:02:57.573863 18379 leader_election.cc:302] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 827a3bbf93b14244b0e46e8031a2ed60, f012ea578b2841789787372f6e6329d9; no voters:
I20260811 10:02:57.574013 18880 raft_consensus.cc:2781] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:02:57.574105 18880 raft_consensus.cc:482] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:02:57.574137 18880 raft_consensus.cc:3037] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.574868 18880 raft_consensus.cc:504] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.575019 18880 leader_election.cc:288] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [CANDIDATE]: Term 1 election: Requested vote from peers 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405), 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229)
I20260811 10:02:57.575184 18758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "188418efbc284cdb9c0fed459c0fab13" candidate_uuid: "f012ea578b2841789787372f6e6329d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0290928e76dc415d8bd7cf9eaff6e486"
I20260811 10:02:57.575225 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "188418efbc284cdb9c0fed459c0fab13" candidate_uuid: "f012ea578b2841789787372f6e6329d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827a3bbf93b14244b0e46e8031a2ed60"
I20260811 10:02:57.575268 18758 raft_consensus.cc:3037] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.575316 18604 raft_consensus.cc:3037] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:02:57.575925 18604 raft_consensus.cc:2454] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f012ea578b2841789787372f6e6329d9 in term 1.
I20260811 10:02:57.575945 18758 raft_consensus.cc:2454] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f012ea578b2841789787372f6e6329d9 in term 1.
I20260811 10:02:57.576095 18379 leader_election.cc:302] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 827a3bbf93b14244b0e46e8031a2ed60, f012ea578b2841789787372f6e6329d9; no voters:
I20260811 10:02:57.576221 18880 raft_consensus.cc:2781] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:02:57.576299 18880 raft_consensus.cc:686] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 1 LEADER]: Becoming Leader. State: Replica: f012ea578b2841789787372f6e6329d9, State: Running, Role: LEADER
I20260811 10:02:57.576359 18880 consensus_queue.cc:237] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } }
I20260811 10:02:57.576964 18285 catalog_manager.cc:5495] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f012ea578b2841789787372f6e6329d9 (127.9.127.193). New cstate: current_term: 1 leader_uuid: "f012ea578b2841789787372f6e6329d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f012ea578b2841789787372f6e6329d9" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 } health_report { overall_health: UNKNOWN } } }
I20260811 10:02:57.611294 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.609094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39296 (local address 127.9.127.193:35705)
0811 10:02:57.609139 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.609141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.609150 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:02:57.609216 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.609217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.609231 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.609280 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:57.609410 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.609881 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.610606 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.610806 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.610879 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.611030 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.611065 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.611129 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.611187 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.611211 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:02:57.615113 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.613363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:60601 (local address 127.9.127.193:35705)
0811 10:02:57.613397 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 10:02:57.613399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:02:57.613407 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:02:57.613458 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:02:57.613458 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:02:57.613465 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:02:57.613498 (+ 33us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:02:57.613567 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.613976 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.614564 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.614719 (+ 155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.614795 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.614896 (+ 101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.614916 (+ 20us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.614980 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 10:02:57.615034 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 10:02:57.615050 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 10:02:57.615183 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.613311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:35705 (local address 127.9.127.193:60601)
0811 10:02:57.613359 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.613367 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:02:57.613403 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:02:57.613502 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:02:57.613502 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:02:57.613503 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 10:02:57.613534 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.613535 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.614029 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.614029 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.614502 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:02:57.614503 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:02:57.614795 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:02:57.614796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:02:57.614831 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:02:57.614837 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 10:02:57.614993 (+ 156us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 10:02:57.614995 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:02:57.615034 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 10:02:57.615088 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 10:02:57.616922 18758 raft_consensus.cc:1261] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Refusing update from remote peer f012ea578b2841789787372f6e6329d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.617022 18604 raft_consensus.cc:1261] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Refusing update from remote peer f012ea578b2841789787372f6e6329d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:02:57.617233 18880 consensus_queue.cc:1035] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "827a3bbf93b14244b0e46e8031a2ed60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 36405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.617337 18873 consensus_queue.cc:1035] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0290928e76dc415d8bd7cf9eaff6e486" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:02:57.627447 18286 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:57.627562 18286 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:02:57.628221 18286 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b4a8dbb9b5f7465fa793e58f318e0147: Sending DeleteTablet for 3 replicas of tablet 188418efbc284cdb9c0fed459c0fab13
I20260811 10:02:57.628453 18431 tablet_service.cc:1514] Processing DeleteTablet for tablet 188418efbc284cdb9c0fed459c0fab13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:39282
I20260811 10:02:57.628481 18583 tablet_service.cc:1514] Processing DeleteTablet for tablet 188418efbc284cdb9c0fed459c0fab13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:47542
I20260811 10:02:57.628477 18735 tablet_service.cc:1514] Processing DeleteTablet for tablet 188418efbc284cdb9c0fed459c0fab13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:02:57 UTC) from {username='oryx', principal='oryx/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:45104
I20260811 10:02:57.628538 18857 tablet_replica.cc:330] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9: stopping tablet replica
I20260811 10:02:57.628569 18858 tablet_replica.cc:330] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: stopping tablet replica
I20260811 10:02:57.628580 18856 tablet_replica.cc:330] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: stopping tablet replica
I20260811 10:02:57.628600 18857 raft_consensus.cc:2229] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:02:57.628607 18858 raft_consensus.cc:2229] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:57.628624 18856 raft_consensus.cc:2229] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:02:57.628636 18858 raft_consensus.cc:2258] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.628656 18856 raft_consensus.cc:2258] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.628690 18857 raft_consensus.cc:2258] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:02:57.629019 18857 ts_tablet_manager.cc:1905] T 188418efbc284cdb9c0fed459c0fab13 P f012ea578b2841789787372f6e6329d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.629055 18856 ts_tablet_manager.cc:1905] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.629318 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 18361
I20260811 10:02:57.630900 18856 ts_tablet_manager.cc:1918] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:57.630941 18856 log.cc:1196] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/188418efbc284cdb9c0fed459c0fab13
I20260811 10:02:57.631102 18856 ts_tablet_manager.cc:1939] T 188418efbc284cdb9c0fed459c0fab13 P 0290928e76dc415d8bd7cf9eaff6e486: Deleting consensus metadata
I20260811 10:02:57.631383 18264 catalog_manager.cc:4841] TS 0290928e76dc415d8bd7cf9eaff6e486 (127.9.127.195:40229): tablet 188418efbc284cdb9c0fed459c0fab13 (table test-table [id=6f7ab67a907f4941b7fc4c153ad6a83a]) successfully deleted
I20260811 10:02:57.637099 18858 ts_tablet_manager.cc:1905] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:02:57.638336 18858 ts_tablet_manager.cc:1918] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 10:02:57.638433 18858 log.cc:1196] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/188418efbc284cdb9c0fed459c0fab13
I20260811 10:02:57.638644 18858 ts_tablet_manager.cc:1939] T 188418efbc284cdb9c0fed459c0fab13 P 827a3bbf93b14244b0e46e8031a2ed60: Deleting consensus metadata
I20260811 10:02:57.638979 18265 catalog_manager.cc:4841] TS 827a3bbf93b14244b0e46e8031a2ed60 (127.9.127.194:36405): tablet 188418efbc284cdb9c0fed459c0fab13 (table test-table [id=6f7ab67a907f4941b7fc4c153ad6a83a]) successfully deleted
W20260811 10:02:57.640733 18267 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:35705 (error 108)
I20260811 10:02:57.641028 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 18515
I20260811 10:02:57.642117 18827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:02:57.641218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:35705 (local address 127.0.0.1:39310)
0811 10:02:57.642031 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0811 10:02:57.642074 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:35705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":786}
W20260811 10:02:57.642230 18267 catalog_manager.cc:4584] TS f012ea578b2841789787372f6e6329d9 (127.9.127.193:35705): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 188418efbc284cdb9c0fed459c0fab13: Network error: Client connection negotiation failed: client connection to 127.9.127.193:35705: connect: Connection refused (error 111)
I20260811 10:02:57.648263 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 18666
I20260811 10:02:57.655652 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 18248
2026-08-11T10:02:57Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2313 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18923](info): set up 2 sockets
Aug 11 10:02:57 dist-test-slave-1x4g krb5kdc[18923](info): commencing operation
krb5kdc: starting...
W20260811 10:02:58.706014 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.026s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:02:58 dist-test-slave-1x4g krb5kdc[18923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:02:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:02:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:02:58.823701 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41269
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:35773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:41269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:02:58.904610 18936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:02:58.904881 18936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:02:58.904932 18936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:02:58.906095 18936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:02:58.906163 18936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:02:58.906188 18936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:02:58.906219 18936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:02:58.906250 18936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:02:58.907716 18936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:35773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:41269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:02:58.907960 18936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:02:58.908164 18936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:02:58.912876 18945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:02:58.912875 18942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:58.913141 18936 server_base.cc:1034] running on GCE node
W20260811 10:02:58.913225 18943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:02:58.913455 18936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:02:58.913712 18936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:02:58.914872 18936 hybrid_clock.cc:648] HybridClock initialized: now 1786442578914865 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T10:02:58Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1261 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:02:58 dist-test-slave-1x4g krb5kdc[18950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:02:58 dist-test-slave-1x4g krb5kdc[18950](info): set up 2 sockets
Aug 11 10:02:58 dist-test-slave-1x4g krb5kdc[18950](info): commencing operation
krb5kdc: starting...
W20260811 10:02:59.981729 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:03:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:03:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:03:00.093575 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35017
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:35017
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:00.172662 18965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:00.172907 18965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:00.172947 18965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:00.174093 18965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:03:00.174157 18965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:00.174181 18965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:00.174203 18965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:03:00.174232 18965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:03:00.175678 18965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:35017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:00.175952 18965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:00.176183 18965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:00.181097 18973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.181034 18971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.181025 18970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:00.181207 18965 server_base.cc:1034] running on GCE node
I20260811 10:03:00.181540 18965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:00.181816 18965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:00.183017 18965 hybrid_clock.cc:648] HybridClock initialized: now 1786442580183013 us; error 65 us; skew 500 ppm
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:00.185446 18965 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:03:00.185882 18965 webserver.cc:460] Webserver started at http://127.9.127.254:33607/ using document root <none> and password file <none>
I20260811 10:03:00.186082 18965 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:00.186123 18965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:00.186209 18965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:00.187186 18965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "6ff530c84ca647b8a022a9c9dd09e2f7"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "4619b288bd4d1d2d70f0f8f9204b0062"
server_key_iv: "1f7ad1de944eee84bd038cbf62b186ad"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.187481 18965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "6ff530c84ca647b8a022a9c9dd09e2f7"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "4619b288bd4d1d2d70f0f8f9204b0062"
server_key_iv: "1f7ad1de944eee84bd038cbf62b186ad"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.188874 18965 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:03:00.189563 18980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.189718 18965 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:03:00.189805 18965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6ff530c84ca647b8a022a9c9dd09e2f7"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "4619b288bd4d1d2d70f0f8f9204b0062"
server_key_iv: "1f7ad1de944eee84bd038cbf62b186ad"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.189859 18965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:00.207602 18965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:00.209898 18965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:00.210028 18965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:00.214080 18965 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:35017
I20260811 10:03:00.214190 19035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:35017 every 8 connection(s)
I20260811 10:03:00.214514 18965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:03:00.215373 19036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:03:00.217689 19036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Bootstrap starting.
I20260811 10:03:00.218139 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 18965
I20260811 10:03:00.218259 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:03:00.218439 19036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Neither blocks nor log segments found. Creating new log.
I20260811 10:03:00.218465 9727 external_mini_cluster.cc:1428] Setting key 6c3398a2976737075adad2d30a612a48
I20260811 10:03:00.218794 19036 log.cc:824] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Log is configured to *not* fsync() on all Append() calls
I20260811 10:03:00.219650 19036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: No bootstrap required, opened a new log
I20260811 10:03:00.222095 19036 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } }
I20260811 10:03:00.222268 19036 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:03:00.222307 19036 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff530c84ca647b8a022a9c9dd09e2f7, State: Initialized, Role: FOLLOWER
I20260811 10:03:00.222430 19036 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } }
I20260811 10:03:00.222503 19036 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:03:00.222548 19036 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:03:00.222597 19036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:03:00.223196 19036 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } }
I20260811 10:03:00.223301 19036 leader_election.cc:302] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ff530c84ca647b8a022a9c9dd09e2f7; no voters:
I20260811 10:03:00.223448 19036 leader_election.cc:288] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:03:00.223510 19041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:03:00.223675 19036 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:03:00.223693 19041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 1 LEADER]: Becoming Leader. State: Replica: 6ff530c84ca647b8a022a9c9dd09e2f7, State: Running, Role: LEADER
I20260811 10:03:00.223811 19041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } }
I20260811 10:03:00.224166 19041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ff530c84ca647b8a022a9c9dd09e2f7. Latest consensus state: current_term: 1 leader_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } } }
I20260811 10:03:00.224172 19042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } } }
I20260811 10:03:00.224262 19041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:00.224275 19042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:00.224690 19049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:03:00.225265 19049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:03:00.226919 19049 catalog_manager.cc:1347] Generated new cluster ID: 2884b51a09414250b5dc5d93b3eba6f5
I20260811 10:03:00.226969 19049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:03:00.230964 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:00.218972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47996 (local address 127.9.127.254:35017)
0811 10:03:00.219154 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:00.219161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:00.219185 (+ 24us) server_negotiation.cc:407] Connection header received
0811 10:03:00.219784 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:00.219795 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:00.219852 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:00.220018 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:00.220616 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.222147 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.223058 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.223687 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.223796 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:00.226775 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:00.226780 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:00.226780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:00.226791 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:00.228861 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:00.229264 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:00.229267 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:00.229267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:00.229373 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:00.229597 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:00.229598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:00.229598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:00.229892 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:00.230040 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:00.230590 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 10:03:00.230728 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260811 10:03:00.238232 19049 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:03:00.238934 19049 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:03:00.241863 19049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Generated new TSK 0
I20260811 10:03:00.242081 19049 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:03:00.271231 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35017
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:00.356623 19064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:00.356909 19064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:00.356950 19064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:00.358107 19064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:00.358171 19064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:00.358217 19064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:03:00.359647 19064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:00.359911 19064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:00.360174 19064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:00.365103 19073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.365113 19071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:00.365222 19064 server_base.cc:1034] running on GCE node
W20260811 10:03:00.365150 19070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:00.365512 19064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:00.365757 19064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:00.366914 19064 hybrid_clock.cc:648] HybridClock initialized: now 1786442580366900 us; error 27 us; skew 500 ppm
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:00.373347 19064 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:03:00.373765 19064 webserver.cc:460] Webserver started at http://127.9.127.193:43051/ using document root <none> and password file <none>
I20260811 10:03:00.374006 19064 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:00.374074 19064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:00.374233 19064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:00.375231 19064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "22beb76a92af4b0bbebd083ef23a3cc6"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "9fe95c92c6ad8d404b08619ad866b8e4"
server_key_iv: "3d177443bcb7063719144ef9a694b6bb"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.375593 19064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "22beb76a92af4b0bbebd083ef23a3cc6"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "9fe95c92c6ad8d404b08619ad866b8e4"
server_key_iv: "3d177443bcb7063719144ef9a694b6bb"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.377036 19064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:03:00.377836 19080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.378091 19064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:03:00.378180 19064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "22beb76a92af4b0bbebd083ef23a3cc6"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "9fe95c92c6ad8d404b08619ad866b8e4"
server_key_iv: "3d177443bcb7063719144ef9a694b6bb"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.378234 19064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:00.403651 19064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:00.405555 19064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:00.405668 19064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:00.405855 19064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:00.406179 19064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:00.406214 19064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.406236 19064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:00.406284 19064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.412195 19064 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:37307
I20260811 10:03:00.412252 19205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:37307 every 8 connection(s)
I20260811 10:03:00.412571 19064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:03:00.417025 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 19064
I20260811 10:03:00.417148 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:03:00.417394 9727 external_mini_cluster.cc:1428] Setting key b5c376b8ec87a76a61224bb0f24c92ce
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:03:00.422767 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:00.413454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:46135 (local address 127.9.127.254:35017)
0811 10:03:00.413524 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:00.413526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:00.413732 (+ 206us) server_negotiation.cc:407] Connection header received
0811 10:03:00.414212 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:00.414213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:00.414222 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:00.414277 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:00.415187 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.415695 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.416703 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.416914 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.416967 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:00.419565 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:00.419566 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:00.419567 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:00.419576 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:00.421299 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:00.421796 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:00.421797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:00.421797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:00.421852 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:00.422147 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:00.422148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:00.422148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:00.422252 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:00.422304 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:00.422634 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 10:03:00.422703 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 10:03:00.423126 19208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:00.413410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:46135)
0811 10:03:00.413603 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:00.413646 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:00.414132 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:00.414329 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:00.414332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:00.414918 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:00.415112 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:00.415117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.415779 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.415779 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:00.416617 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:00.416620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.417012 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.417014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:00.417186 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:00.417820 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:00.417830 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:00.419448 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:00.421379 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:00.421386 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:00.421387 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:00.421709 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:00.421919 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:00.421920 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:00.421920 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:00.422073 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:00.422317 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:00.422325 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:00.422497 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 10:03:00.422616 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 10:03:00.422804 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":114,"threads_started":1}
I20260811 10:03:00.423750 19206 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35017
I20260811 10:03:00.423870 19206 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:00.424070 19206 heartbeater.cc:511] Master 127.9.127.254:35017 requested a full tablet report, sending...
I20260811 10:03:00.424728 18998 ts_manager.cc:194] Registered new tserver with Master: 22beb76a92af4b0bbebd083ef23a3cc6 (127.9.127.193:37307)
I20260811 10:03:00.425351 18998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:46135
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:03:00.443611 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35017
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:00.523378 19212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:00.523554 19212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:00.523576 19212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:00.524865 19212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:00.524914 19212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:00.524946 19212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:03:00.526381 19212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:00.526551 19212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:00.526711 19212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:00.531490 19220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.531497 19223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.531502 19221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:00.531571 19212 server_base.cc:1034] running on GCE node
I20260811 10:03:00.531864 19212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:00.532133 19212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:00.533303 19212 hybrid_clock.cc:648] HybridClock initialized: now 1786442580533288 us; error 29 us; skew 500 ppm
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:00.535681 19212 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:03:00.536024 19212 webserver.cc:460] Webserver started at http://127.9.127.194:42593/ using document root <none> and password file <none>
I20260811 10:03:00.536194 19212 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:00.536250 19212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:00.536332 19212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:00.537387 19212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "7f524b3a40784f81b9fd4f9373c78ae3"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "b5b510fd3898e692930ba12c6611e87b"
server_key_iv: "0d9bef87e48136b3fb787e10d54ba0d1"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.537770 19212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "7f524b3a40784f81b9fd4f9373c78ae3"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "b5b510fd3898e692930ba12c6611e87b"
server_key_iv: "0d9bef87e48136b3fb787e10d54ba0d1"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.539062 19212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:03:00.539779 19230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.539961 19212 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:03:00.540053 19212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "7f524b3a40784f81b9fd4f9373c78ae3"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "b5b510fd3898e692930ba12c6611e87b"
server_key_iv: "0d9bef87e48136b3fb787e10d54ba0d1"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.540163 19212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:00.558437 19212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:00.560218 19212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:00.560381 19212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:00.560631 19212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:00.560979 19212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:00.561021 19212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.561043 19212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:00.561091 19212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.567358 19212 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:34851
I20260811 10:03:00.567426 19355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:34851 every 8 connection(s)
I20260811 10:03:00.567778 19212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:03:00.568080 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 19212
I20260811 10:03:00.568185 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:03:00.568408 9727 external_mini_cluster.cc:1428] Setting key 9f9f3ad712b2ccb8b9218b064c3bc251
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:03:00.578418 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:00.568581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:34277 (local address 127.9.127.254:35017)
0811 10:03:00.568633 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:00.568635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:00.568972 (+ 337us) server_negotiation.cc:407] Connection header received
0811 10:03:00.569556 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:00.569557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:00.569569 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:00.569632 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:00.570544 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.571236 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.572543 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.572728 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.572839 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:00.575422 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:00.575424 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:00.575424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:00.575432 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:00.576898 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:00.577373 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:00.577374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:00.577374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:00.577428 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:00.577772 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:00.577772 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:00.577773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:00.577874 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:00.577928 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:00.578288 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 10:03:00.578354 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
I20260811 10:03:00.578712 19358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:00.568492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:34277)
0811 10:03:00.568836 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:00.568895 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:00.569444 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:00.569683 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:00.569686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:00.570262 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:00.570449 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:00.570454 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.571330 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.571331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:00.572462 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:00.572465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.572855 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.572856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:00.572981 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:00.573526 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:00.573535 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:00.575313 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:00.576975 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:00.576983 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:00.576985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:00.577288 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:00.577514 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:00.577515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:00.577516 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:00.577698 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:00.577949 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:00.577957 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:00.578139 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 10:03:00.578265 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 10:03:00.578429 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":89,"threads_started":1}
I20260811 10:03:00.579244 19356 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35017
I20260811 10:03:00.579331 19356 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:00.579566 19356 heartbeater.cc:511] Master 127.9.127.254:35017 requested a full tablet report, sending...
I20260811 10:03:00.579962 18998 ts_manager.cc:194] Registered new tserver with Master: 7f524b3a40784f81b9fd4f9373c78ae3 (127.9.127.194:34851)
I20260811 10:03:00.580317 18998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:34277
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:03:00.595263 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35017
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:00.676198 19362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:00.676393 19362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:00.676416 19362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:00.677560 19362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:00.677597 19362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:00.677623 19362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:03:00.678937 19362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:00.679114 19362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:00.679276 19362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:00.684204 19371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.684217 19367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.684332 19368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:00.684397 19362 server_base.cc:1034] running on GCE node
I20260811 10:03:00.684711 19362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:00.684998 19362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:00.686173 19362 hybrid_clock.cc:648] HybridClock initialized: now 1786442580686158 us; error 30 us; skew 500 ppm
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:00.688616 19362 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:03:00.689081 19362 webserver.cc:460] Webserver started at http://127.9.127.195:46229/ using document root <none> and password file <none>
I20260811 10:03:00.689316 19362 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:00.689381 19362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:00.689532 19362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:00.690536 19362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "80b52efc70334554a6ec611c97607efa"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "82226ebb2e628da601f45eb6729d0e41"
server_key_iv: "8613574ab6e72157a900e1a65a4e0d99"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.690883 19362 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "80b52efc70334554a6ec611c97607efa"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "82226ebb2e628da601f45eb6729d0e41"
server_key_iv: "8613574ab6e72157a900e1a65a4e0d99"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.692230 19362 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:03:00.693027 19381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.693216 19362 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:03:00.693316 19362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "80b52efc70334554a6ec611c97607efa"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "82226ebb2e628da601f45eb6729d0e41"
server_key_iv: "8613574ab6e72157a900e1a65a4e0d99"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.693397 19362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:00.707089 19362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:00.708868 19362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:00.709018 19362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:00.709224 19362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:00.709530 19362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:00.709583 19362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.709620 19362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:00.709646 19362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.715281 19362 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:38717
I20260811 10:03:00.715356 19501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:38717 every 8 connection(s)
I20260811 10:03:00.715673 19362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:03:00.720125 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 19362
I20260811 10:03:00.720270 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:03:00.720520 9727 external_mini_cluster.cc:1428] Setting key a80844910448a78c2bde749c58b7246b
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:03:00.725159 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:00.716391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:59795 (local address 127.9.127.254:35017)
0811 10:03:00.716439 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:00.716441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:00.716615 (+ 174us) server_negotiation.cc:407] Connection header received
0811 10:03:00.717181 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:00.717182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:00.717192 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:00.717248 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:00.718147 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.718623 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.719577 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.719760 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.719813 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:00.722315 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:00.722317 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:00.722317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:00.722324 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:00.723780 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:00.724190 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:00.724190 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:00.724191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:00.724244 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:00.724481 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:00.724482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:00.724483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:00.724628 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:00.724689 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:00.724986 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 10:03:00.725098 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:03:00.725327 19505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:00.716346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:59795)
0811 10:03:00.716504 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:00.716544 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:00.717092 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:00.717324 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:00.717327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:00.717872 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:00.718053 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:00.718057 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.718701 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.718701 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:00.719506 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:00.719508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:00.719835 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:00.719835 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:00.719931 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:00.720477 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:00.720488 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:00.722231 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:00.723846 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:00.723851 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:00.723853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:00.724125 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:00.724301 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:00.724302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:00.724302 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:00.724395 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:00.724696 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:00.724703 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:00.724888 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 10:03:00.724973 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 10:03:00.725137 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260811 10:03:00.725750 19502 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35017
I20260811 10:03:00.725862 19502 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:00.726046 19502 heartbeater.cc:511] Master 127.9.127.254:35017 requested a full tablet report, sending...
I20260811 10:03:00.726399 18998 ts_manager.cc:194] Registered new tserver with Master: 80b52efc70334554a6ec611c97607efa (127.9.127.195:38717)
I20260811 10:03:00.726761 18998 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:59795
I20260811 10:03:00.732210 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab.
Entry for principal oryx/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab.
WARNING: no policy specified for oryx/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab.
Entry for principal oryx/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab.
WARNING: no policy specified for oryx/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab.
Entry for principal oryx/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab.
I20260811 10:03:00.800377 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 19064
I20260811 10:03:00.808046 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 19212
I20260811 10:03:00.816285 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 19362
I20260811 10:03:00.821918 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 18965
I20260811 10:03:00.828284 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35017
--webserver_interface=127.9.127.254
--webserver_port=33607
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:35017
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:00.911518 19513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:00.911772 19513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:00.911808 19513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:00.912983 19513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:03:00.913049 19513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:00.913071 19513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:00.913115 19513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:03:00.913154 19513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:03:00.914714 19513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:35017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=33607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:00.915009 19513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:00.915247 19513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:00.920130 19519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.920197 19522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:00.920156 19520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:00.920406 19513 server_base.cc:1034] running on GCE node
I20260811 10:03:00.920655 19513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:00.920977 19513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:00.922123 19513 hybrid_clock.cc:648] HybridClock initialized: now 1786442580922100 us; error 40 us; skew 500 ppm
Aug 11 10:03:00 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442580, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:00.924638 19513 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:03:00.925127 19513 webserver.cc:460] Webserver started at http://127.9.127.254:33607/ using document root <none> and password file <none>
I20260811 10:03:00.925316 19513 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:00.925370 19513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:00.926694 19513 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:03:00.927313 19530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:00.927489 19513 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:03:00.927594 19513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6ff530c84ca647b8a022a9c9dd09e2f7"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "4619b288bd4d1d2d70f0f8f9204b0062"
server_key_iv: "1f7ad1de944eee84bd038cbf62b186ad"
server_key_version: "encryptionkey@0"
I20260811 10:03:00.927939 19513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:00.945122 19513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:00.946931 19513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:00.947099 19513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:00.951390 19513 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:35017
I20260811 10:03:00.951422 19589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:35017 every 8 connection(s)
I20260811 10:03:00.951817 19513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:03:00.953413 19590 sys_catalog.cc:263] Verifying existing consensus state
I20260811 10:03:00.954082 19590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Bootstrap starting.
I20260811 10:03:00.954902 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 19513
I20260811 10:03:00.955222 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:37307
--local_ip_for_outbound_sockets=127.9.127.193
--tserver_master_addrs=127.9.127.254:35017
--webserver_port=43051
--webserver_interface=127.9.127.193
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.127.193
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:03:00.963454 19590 log.cc:824] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Log is configured to *not* fsync() on all Append() calls
I20260811 10:03:00.965337 19590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:03:00.965629 19590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Bootstrap complete.
I20260811 10:03:00.967983 19590 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } }
I20260811 10:03:00.968237 19590 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff530c84ca647b8a022a9c9dd09e2f7, State: Initialized, Role: FOLLOWER
I20260811 10:03:00.968461 19590 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } }
I20260811 10:03:00.968564 19590 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:03:00.968618 19590 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:03:00.968665 19590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 1 FOLLOWER]: Advancing to term 2
I20260811 10:03:00.969734 19590 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } }
I20260811 10:03:00.969856 19590 leader_election.cc:302] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ff530c84ca647b8a022a9c9dd09e2f7; no voters:
I20260811 10:03:00.970059 19590 leader_election.cc:288] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 10:03:00.970100 19594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 10:03:00.970219 19594 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [term 2 LEADER]: Becoming Leader. State: Replica: 6ff530c84ca647b8a022a9c9dd09e2f7, State: Running, Role: LEADER
I20260811 10:03:00.970341 19590 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:03:00.970382 19594 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } }
I20260811 10:03:00.970695 19594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ff530c84ca647b8a022a9c9dd09e2f7. Latest consensus state: current_term: 2 leader_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } } }
I20260811 10:03:00.970706 19595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ff530c84ca647b8a022a9c9dd09e2f7" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35017 } } }
I20260811 10:03:00.970968 19595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:00.970888 19594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:00.971200 19605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:03:00.971844 19605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:03:00.972087 19605 catalog_manager.cc:1259] Loaded cluster ID: 2884b51a09414250b5dc5d93b3eba6f5
I20260811 10:03:00.972321 19605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:03:00.973242 19605 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:03:00.973431 19605 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6ff530c84ca647b8a022a9c9dd09e2f7: Loaded TSK: 0
I20260811 10:03:00.973664 19605 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 10:03:01.052863 19592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:01.053076 19592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:01.053124 19592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:01.054309 19592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:01.054378 19592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:01.054422 19592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:03:01.055863 19592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.193.keytab
--principal=oryx/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:37307
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=43051
--tserver_master_addrs=127.9.127.254:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:01.056125 19592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:01.056352 19592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:01.062243 19619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:01.062351 19592 server_base.cc:1034] running on GCE node
W20260811 10:03:01.062439 19622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:01.062253 19618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:01.062733 19592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:01.063020 19592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:01.064213 19592 hybrid_clock.cc:648] HybridClock initialized: now 1786442581064198 us; error 28 us; skew 500 ppm
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442581, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:01.067085 19592 init.cc:377] Logged in from keytab as oryx/127.9.127.193@KRBTEST.COM (short username oryx)
I20260811 10:03:01.067495 19592 webserver.cc:460] Webserver started at http://127.9.127.193:43051/ using document root <none> and password file <none>
I20260811 10:03:01.067723 19592 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:01.067800 19592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:01.069121 19592 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:03:01.069782 19629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.069988 19592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:03:01.070112 19592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "22beb76a92af4b0bbebd083ef23a3cc6"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "9fe95c92c6ad8d404b08619ad866b8e4"
server_key_iv: "3d177443bcb7063719144ef9a694b6bb"
server_key_version: "encryptionkey@0"
I20260811 10:03:01.070478 19592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:01.078189 19592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:01.080400 19592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:01.080541 19592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:01.080859 19592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:01.081220 19592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:01.081264 19592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.081286 19592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:01.081323 19592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.088409 19592 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:37307
I20260811 10:03:01.088501 19759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:37307 every 8 connection(s)
I20260811 10:03:01.088907 19592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:03:01.091017 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 19592
I20260811 10:03:01.091331 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:34851
--local_ip_for_outbound_sockets=127.9.127.194
--tserver_master_addrs=127.9.127.254:35017
--webserver_port=42593
--webserver_interface=127.9.127.194
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.127.194
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:01.099272 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.089645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:45897)
0811 10:03:01.089838 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.089882 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.090508 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.090927 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.090931 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.091683 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.091870 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.091875 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.093222 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.093223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.094463 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.094467 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.095403 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.095404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.095557 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.096140 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.096150 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.099076 (+ 2926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":101,"threads_started":1}
W20260811 10:03:01.099457 19763 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.089794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:45897 (local address 127.9.127.254:35017)
0811 10:03:01.089955 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.089963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.090002 (+ 39us) server_negotiation.cc:407] Connection header received
0811 10:03:01.090686 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.090691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.090729 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.090886 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.092014 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.093105 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.094571 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.095206 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.095309 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.099252 (+ 3943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:45897: BlockingRecv error: recv got EOF from 127.9.127.193:45897 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
W20260811 10:03:01.099970 19760 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:35017 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.127.254:35017: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:01.105463 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.100199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:44371)
0811 10:03:01.100240 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.100249 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.100281 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.100420 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.100420 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.100559 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.100609 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.100610 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.101607 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.101608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.102391 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.102394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.102936 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.102937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.103013 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.103513 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.103518 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.105400 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 10:03:01.105813 19763 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.100243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:44371 (local address 127.9.127.254:35017)
0811 10:03:01.100277 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.100279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.100288 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:03:01.100337 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.100337 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.100349 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.100412 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.100690 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.101501 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.102502 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.102845 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.102926 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.105757 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:44371: BlockingRecv error: recv got EOF from 127.9.127.193:44371 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:01.111192 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.106247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:43389)
0811 10:03:01.106286 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.106295 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.106325 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.106451 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.106452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.106584 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.106614 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.106615 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.107478 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.107479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.108231 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.108233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.108678 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.108679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.108734 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.109175 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.109180 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.111108 (+ 1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 10:03:01.112381 19760 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 10:03:01.112649 19763 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.106302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:43389 (local address 127.9.127.254:35017)
0811 10:03:01.106332 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.106334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.106343 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:03:01.106366 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.106366 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.106375 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.106433 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.106683 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.107371 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.108313 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.108604 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.108665 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.112596 (+ 3931us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:43389: BlockingRecv error: recv got EOF from 127.9.127.193:43389 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 10:03:01.177569 19764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:01.177759 19764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:01.177783 19764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:01.178903 19764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:01.178943 19764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:01.178966 19764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:03:01.180305 19764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.194.keytab
--principal=oryx/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:34851
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=42593
--tserver_master_addrs=127.9.127.254:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:01.180526 19764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:01.180732 19764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:01.185616 19772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:01.185622 19769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:01.185778 19770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:01.185829 19764 server_base.cc:1034] running on GCE node
I20260811 10:03:01.186053 19764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:01.186321 19764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:01.187460 19764 hybrid_clock.cc:648] HybridClock initialized: now 1786442581187439 us; error 35 us; skew 500 ppm
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442581, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:01.189973 19764 init.cc:377] Logged in from keytab as oryx/127.9.127.194@KRBTEST.COM (short username oryx)
I20260811 10:03:01.190460 19764 webserver.cc:460] Webserver started at http://127.9.127.194:42593/ using document root <none> and password file <none>
I20260811 10:03:01.190666 19764 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:01.190742 19764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:01.192008 19764 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:03:01.192541 19779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.192690 19764 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:03:01.192818 19764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "7f524b3a40784f81b9fd4f9373c78ae3"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "b5b510fd3898e692930ba12c6611e87b"
server_key_iv: "0d9bef87e48136b3fb787e10d54ba0d1"
server_key_version: "encryptionkey@0"
I20260811 10:03:01.193142 19764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:01.210693 19764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:01.213132 19764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:01.213307 19764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:01.213527 19764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:01.213837 19764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:01.213891 19764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.213932 19764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:01.213958 19764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.219892 19764 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:34851
I20260811 10:03:01.219964 19907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:34851 every 8 connection(s)
I20260811 10:03:01.220285 19764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 10:03:01.227077 19763 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.221068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:50333 (local address 127.9.127.254:35017)
0811 10:03:01.221122 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.221124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.221366 (+ 242us) server_negotiation.cc:407] Connection header received
0811 10:03:01.221828 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.221829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.221842 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.221892 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.222808 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.223292 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.224209 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.224378 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.224426 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.227034 (+ 2608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:50333: BlockingRecv error: recv got EOF from 127.9.127.194:50333 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 10:03:01.227084 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.221053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:50333)
0811 10:03:01.221236 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.221272 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.221742 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.221989 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.221992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.222542 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.222728 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.222732 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.223370 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.223371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.224132 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.224134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.224451 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.224452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.224552 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.225003 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.225010 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.226963 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
W20260811 10:03:01.227320 19908 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:35017 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.127.254:35017: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
I20260811 10:03:01.227864 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 19764
I20260811 10:03:01.228142 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:38717
--local_ip_for_outbound_sockets=127.9.127.195
--tserver_master_addrs=127.9.127.254:35017
--webserver_port=46229
--webserver_interface=127.9.127.195
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.9.127.195
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:01.232002 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.227546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:53811)
0811 10:03:01.227610 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.227620 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.227667 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.227816 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.227816 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.227979 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.228031 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.228032 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.228798 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.228799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.229322 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.229324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.229678 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.229679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.229741 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.230138 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.230143 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.231910 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 10:03:01.232062 19763 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.227660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:53811 (local address 127.9.127.254:35017)
0811 10:03:01.227728 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.227730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.227737 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:03:01.227759 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.227759 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.227767 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.227814 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.228124 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.228690 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.229406 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.229607 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.229680 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.231999 (+ 2319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:53811: BlockingRecv error: recv got EOF from 127.9.127.194:53811 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:01.236107 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.232250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:42389)
0811 10:03:01.232345 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.232355 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.232403 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.232526 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.232527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.232651 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.232674 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.232676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.233315 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.233316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.233775 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.233777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.234123 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.234124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.234175 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.234560 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.234564 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.236038 (+ 1474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":80}
W20260811 10:03:01.236159 19763 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.232307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:42389 (local address 127.9.127.254:35017)
0811 10:03:01.232336 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.232339 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.232390 (+ 51us) server_negotiation.cc:407] Connection header received
0811 10:03:01.232459 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.232460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.232468 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.232521 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.232758 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.233238 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.233867 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.234051 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.234124 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.236106 (+ 1982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:42389: BlockingRecv error: recv got EOF from 127.9.127.194:42389 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260811 10:03:01.236287 19908 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 10:03:01.311633 19911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:01.311805 19911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:01.311827 19911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:01.313072 19911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:01.313114 19911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:01.313162 19911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:03:01.314671 19911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/krb5kdc/oryx_127.9.127.195.keytab
--principal=oryx/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:38717
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=46229
--tserver_master_addrs=127.9.127.254:35017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:01.314899 19911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:01.315109 19911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:01.320014 19920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:01.320017 19918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:01.320045 19917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:01.320225 19911 server_base.cc:1034] running on GCE node
I20260811 10:03:01.320502 19911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:01.320729 19911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:01.321863 19911 hybrid_clock.cc:648] HybridClock initialized: now 1786442581321853 us; error 26 us; skew 500 ppm
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442581, etypes {rep=17 tkt=17 ses=17}, oryx/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:01.324375 19911 init.cc:377] Logged in from keytab as oryx/127.9.127.195@KRBTEST.COM (short username oryx)
I20260811 10:03:01.324879 19911 webserver.cc:460] Webserver started at http://127.9.127.195:46229/ using document root <none> and password file <none>
I20260811 10:03:01.325138 19911 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:01.325212 19911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:01.326601 19911 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:03:01.327167 19927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.327337 19911 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:03:01.327442 19911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "80b52efc70334554a6ec611c97607efa"
format_stamp: "Formatted at 2026-08-11 10:03:00 on dist-test-slave-1x4g"
server_key: "82226ebb2e628da601f45eb6729d0e41"
server_key_iv: "8613574ab6e72157a900e1a65a4e0d99"
server_key_version: "encryptionkey@0"
I20260811 10:03:01.327785 19911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:01.340868 19911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:01.342732 19911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:01.342890 19911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:01.343108 19911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:01.343401 19911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:01.343467 19911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.343509 19911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:01.343537 19911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:01.349603 19911 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:38717
I20260811 10:03:01.349673 20053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:38717 every 8 connection(s)
I20260811 10:03:01.349987 19911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:03:01.354475 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 19911
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:01.357960 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.350810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:59223)
0811 10:03:01.350975 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.351009 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.351483 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.351758 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.351761 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.352309 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.352486 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.352490 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.353271 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.353272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.354030 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.354033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.354426 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.354427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.354592 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.355184 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.355196 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.357799 (+ 2603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
W20260811 10:03:01.357980 19763 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.350800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:59223 (local address 127.9.127.254:35017)
0811 10:03:01.350849 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.350851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.351103 (+ 252us) server_negotiation.cc:407] Connection header received
0811 10:03:01.351609 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.351610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.351623 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.351677 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.352597 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.353173 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.354133 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.354341 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.354417 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.357900 (+ 3483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:59223: BlockingRecv error: recv got EOF from 127.9.127.195:59223 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 10:03:01.358235 20054 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:35017 (0 consecutive failures): Not authorized: Failed to ping master at 127.9.127.254:35017: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:01.362941 20059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.355001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48008 (local address 127.9.127.254:35017)
0811 10:03:01.355125 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.355127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.355136 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:03:01.355209 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.355209 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.355219 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.355267 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.356002 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.356677 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.357816 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.358121 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.358183 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.359460 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:01.359464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:01.359465 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:01.359476 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:01.361377 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:01.361767 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:01.361777 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:01.361777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:01.361883 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:01.362136 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:01.362137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:01.362137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:01.362429 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:01.362577 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:01.362707 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 10:03:01.362805 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":53,"threads_started":1}
I20260811 10:03:01.363021 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.358458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:48051)
0811 10:03:01.358509 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.358518 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.358552 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.358932 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.358933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.359064 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.359112 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.359113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.359883 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.359884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.360380 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.360382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.360755 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.360756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.360855 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.361214 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.361218 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.362981 (+ 1763us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 10:03:01.363142 19763 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.358762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:48051 (local address 127.9.127.254:35017)
0811 10:03:01.358823 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.358825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.358831 (+ 6us) server_negotiation.cc:407] Connection header received
0811 10:03:01.358847 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.358848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.358854 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.358913 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.359187 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.359804 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.360483 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.360684 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.360756 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.363076 (+ 2320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:48051: BlockingRecv error: recv got EOF from 127.9.127.195:48051 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:01 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:01.367403 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:01.363254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:52505)
0811 10:03:01.363429 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:01.363439 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:01.363490 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:01.363731 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:01.363732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:01.363882 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:01.363918 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.363919 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.364640 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.364641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.365187 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:01.365189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.365592 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.365593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:01.365644 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.365942 (+ 298us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:01.365946 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:01.367364 (+ 1418us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158}
W20260811 10:03:01.367532 20059 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:01.363311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:52505 (local address 127.9.127.254:35017)
0811 10:03:01.363412 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:01.363414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:01.363476 (+ 62us) server_negotiation.cc:407] Connection header received
0811 10:03:01.363642 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:01.363643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:01.363652 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:01.363712 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:01.363986 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.364565 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.365283 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:01.365489 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:01.365583 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:01.367462 (+ 1879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:52505: BlockingRecv error: recv got EOF from 127.9.127.195:52505 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":80,"threads_started":1}
W20260811 10:03:01.367542 20054 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 10:03:02 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:02 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:02.117687 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:02.112864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:60233)
0811 10:03:02.113006 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:02.113020 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:02.113084 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:02.113223 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:02.113224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:02.113399 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:02.113466 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:02.113468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.114118 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.114118 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:02.114686 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:02.114688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.115042 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.115043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:02.115087 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:02.115531 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:02.115536 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:02.117577 (+ 2041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
W20260811 10:03:02.117776 20063 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:02.112894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:60233 (local address 127.9.127.254:35017)
0811 10:03:02.113031 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:02.113033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:02.113085 (+ 52us) server_negotiation.cc:407] Connection header received
0811 10:03:02.113142 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:02.113142 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:02.113153 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:02.113206 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:02.113532 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.114046 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.114772 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.114974 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.115025 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:02.117688 (+ 2663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:60233: BlockingRecv error: recv got EOF from 127.9.127.193:60233 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
Aug 11 10:03:02 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:02 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:02.241756 20064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:02.236917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:50977)
0811 10:03:02.237036 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:02.237068 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:02.237157 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:02.237363 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:02.237364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:02.237632 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:02.237694 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:02.237698 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.238348 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.238348 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:02.238884 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:02.238885 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.239210 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.239211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:02.239253 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:02.239754 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:02.239759 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:02.241689 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":68,"threads_started":1}
W20260811 10:03:02.241861 20063 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:02.236964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:50977 (local address 127.9.127.254:35017)
0811 10:03:02.237014 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:02.237016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:02.237219 (+ 203us) server_negotiation.cc:407] Connection header received
0811 10:03:02.237256 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:02.237257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:02.237273 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:02.237339 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:02.237775 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.238281 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.238956 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.239146 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.239194 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:02.241782 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:50977: BlockingRecv error: recv got EOF from 127.9.127.194:50977 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 11 10:03:02 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:02 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:02.372942 20065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:02.367880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:58623)
0811 10:03:02.368063 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:02.368074 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:02.368141 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:02.368283 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:02.368285 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:02.368472 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:02.368523 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:02.368525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.369257 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.369259 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:02.369828 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:02.369831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.370204 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.370205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:02.370268 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:02.370825 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:02.370829 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:02.372872 (+ 2043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":95,"threads_started":1}
W20260811 10:03:02.373054 20063 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:02.367969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:58623 (local address 127.9.127.254:35017)
0811 10:03:02.368040 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:02.368042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:02.368122 (+ 80us) server_negotiation.cc:407] Connection header received
0811 10:03:02.368194 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:02.368195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:02.368209 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:02.368274 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:02.368605 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.369150 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.369915 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:02.370128 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:02.370204 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:02.372961 (+ 2757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:58623: BlockingRecv error: recv got EOF from 127.9.127.195:58623 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 10:03:03 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:03 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:03.122699 20066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:03.118236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:39447)
0811 10:03:03.118394 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:03.118406 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:03.118473 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:03.118607 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:03.118608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:03.118764 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:03.118816 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:03.118818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.119428 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.119429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:03.119897 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:03.119898 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.120197 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.120198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:03.120235 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:03.120641 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:03.120645 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:03.122603 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":72,"threads_started":1}
W20260811 10:03:03.122753 20067 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:03.118280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:39447 (local address 127.9.127.254:35017)
0811 10:03:03.118390 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:03.118392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:03.118476 (+ 84us) server_negotiation.cc:407] Connection header received
0811 10:03:03.118516 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:03.118516 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:03.118527 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:03.118586 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:03.118877 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.119366 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.119960 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.120137 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.120181 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:03.122680 (+ 2499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:39447: BlockingRecv error: recv got EOF from 127.9.127.193:39447 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":56,"threads_started":1}
Aug 11 10:03:03 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:03 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:03.247069 20068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:03.242284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:42269)
0811 10:03:03.242466 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:03.242479 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:03.242572 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:03.242786 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:03.242786 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:03.243004 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:03.243059 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:03.243061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.243804 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.243805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:03.244314 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:03.244315 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.244698 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.244700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:03.244758 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:03.245337 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:03.245341 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:03.246978 (+ 1637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":92,"threads_started":1}
W20260811 10:03:03.247133 20067 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:03.242387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:42269 (local address 127.9.127.254:35017)
0811 10:03:03.242463 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:03.242465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:03.242555 (+ 90us) server_negotiation.cc:407] Connection header received
0811 10:03:03.242658 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:03.242659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:03.242673 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:03.242770 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:03.243152 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.243711 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.244423 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.244612 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.244697 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:03.247070 (+ 2373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:42269: BlockingRecv error: recv got EOF from 127.9.127.194:42269 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 10:03:03 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:03 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:03.377739 20069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:03.373396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:51803)
0811 10:03:03.373570 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:03.373589 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:03.373645 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:03.373800 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:03.373801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:03.373962 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:03.374018 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:03.374020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.374689 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.374690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:03.375202 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:03.375203 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.375508 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.375508 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:03.375547 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:03.375960 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:03.375964 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:03.377681 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":125,"threads_started":1}
W20260811 10:03:03.377861 20067 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:03.373493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:51803 (local address 127.9.127.254:35017)
0811 10:03:03.373560 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:03.373561 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:03.373685 (+ 124us) server_negotiation.cc:407] Connection header received
0811 10:03:03.373711 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:03.373711 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:03.373726 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:03.373784 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:03.374084 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.374625 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.375271 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:03.375445 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:03.375493 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:03.377776 (+ 2283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:51803: BlockingRecv error: recv got EOF from 127.9.127.195:51803 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 10:03:04 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:04 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:04.127720 20070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:04.123168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:38447)
0811 10:03:04.123340 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:04.123350 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:04.123405 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:04.123564 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:04.123565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:04.123724 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:04.123775 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:04.123777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.124394 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.124395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:04.124913 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:04.124915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.125262 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.125262 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:04.125303 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:04.125717 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:04.125721 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:04.127665 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":104,"threads_started":1}
W20260811 10:03:04.127857 20071 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:04.123240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:38447 (local address 127.9.127.254:35017)
0811 10:03:04.123367 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:04.123368 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:04.123390 (+ 22us) server_negotiation.cc:407] Connection header received
0811 10:03:04.123470 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:04.123471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:04.123482 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:04.123541 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:04.123833 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.124327 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.125006 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.125197 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.125248 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:04.127769 (+ 2521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:38447: BlockingRecv error: recv got EOF from 127.9.127.193:38447 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
Aug 11 10:03:04 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:04 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:04.251864 20072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:04.247607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:53417)
0811 10:03:04.247744 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:04.247755 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:04.247820 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:04.247932 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:04.247933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:04.248098 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:04.248151 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:04.248152 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.248761 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.248762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:04.249273 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:04.249275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.249587 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.249588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:04.249627 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:04.250071 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:04.250075 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:04.251806 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
W20260811 10:03:04.251995 20071 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:04.247680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:53417 (local address 127.9.127.254:35017)
0811 10:03:04.247753 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:04.247755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:04.247816 (+ 61us) server_negotiation.cc:407] Connection header received
0811 10:03:04.247868 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:04.247869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:04.247880 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:04.247930 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:04.248204 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.248689 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.249335 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.249519 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.249568 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:04.251916 (+ 2348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:53417: BlockingRecv error: recv got EOF from 127.9.127.194:53417 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 10:03:04 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:04 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:04.382841 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:04.378328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:56925)
0811 10:03:04.378494 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:04.378505 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:04.378558 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:04.378701 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:04.378702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:04.378859 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:04.378911 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:04.378913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.379503 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.379503 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:04.380002 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:04.380003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.380300 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.380301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:04.380340 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:04.380752 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:04.380757 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:04.382783 (+ 2026us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
W20260811 10:03:04.382951 20071 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:04.378394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:56925 (local address 127.9.127.254:35017)
0811 10:03:04.378463 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:04.378465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:04.378560 (+ 95us) server_negotiation.cc:407] Connection header received
0811 10:03:04.378615 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:04.378616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:04.378628 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:04.378677 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:04.378972 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.379441 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.380068 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:04.380238 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:04.380284 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:04.382875 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:56925: BlockingRecv error: recv got EOF from 127.9.127.195:56925 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 10:03:05 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:05 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:05.132757 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:05.128143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:52489)
0811 10:03:05.128266 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:05.128279 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:05.128330 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:05.128628 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:05.128629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:05.128797 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:05.128848 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:05.128849 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.129456 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.129457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:05.129929 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:05.129930 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.130309 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.130310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:05.130355 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:05.130833 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:05.130838 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:05.132703 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
W20260811 10:03:05.132962 20078 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:05.128354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:52489 (local address 127.9.127.254:35017)
0811 10:03:05.128503 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:05.128505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:05.128512 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:03:05.128532 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:05.128533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:05.128542 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:05.128611 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:05.128897 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.129393 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.130054 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.130234 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.130283 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:05.132878 (+ 2595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:52489: BlockingRecv error: recv got EOF from 127.9.127.193:52489 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
Aug 11 10:03:05 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:05 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:05.257426 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:05.252503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:43711)
0811 10:03:05.252687 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:05.252701 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:05.252767 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:05.252984 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:05.252986 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:05.253199 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:05.253248 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:05.253250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.253976 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.253977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:05.254507 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:05.254508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.254905 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.254906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:05.254972 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:05.255518 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:05.255523 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:05.257328 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":107,"threads_started":1}
W20260811 10:03:05.257475 20078 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:05.252576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:43711 (local address 127.9.127.254:35017)
0811 10:03:05.252650 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:05.252661 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:05.252847 (+ 186us) server_negotiation.cc:407] Connection header received
0811 10:03:05.252881 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:05.252882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:05.252897 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:05.252956 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:05.253334 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.253890 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.254599 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.254798 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.254907 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:05.257411 (+ 2504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:43711: BlockingRecv error: recv got EOF from 127.9.127.194:43711 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 10:03:05 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:05 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:05.392995 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:05.383337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:53717)
0811 10:03:05.383517 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:05.383528 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:05.383593 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:05.383806 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:05.383807 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:05.383968 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:05.384032 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:05.384034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.384677 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.384677 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:05.385199 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:05.385201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.385524 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.385525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:05.385566 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:05.391041 (+ 5475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:05.391046 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:05.392904 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":95,"threads_started":1}
W20260811 10:03:05.393096 20078 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:05.383389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:53717 (local address 127.9.127.254:35017)
0811 10:03:05.383463 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:05.383465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:05.383686 (+ 221us) server_negotiation.cc:407] Connection header received
0811 10:03:05.383715 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:05.383716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:05.383730 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:05.383787 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:05.384110 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.384617 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.385272 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:05.385454 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:05.385511 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:05.393006 (+ 7495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:53717: BlockingRecv error: recv got EOF from 127.9.127.195:53717 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 10:03:06 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:06 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:06.137666 20081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:06.133220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:50905)
0811 10:03:06.133377 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:06.133388 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:06.133443 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:06.133586 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:06.133586 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:06.133747 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:06.133798 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:06.133800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.134419 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.134419 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:06.134922 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:06.134924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.135242 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.135242 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:06.135283 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:06.135718 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:06.135723 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:06.137569 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":87,"threads_started":1}
W20260811 10:03:06.137720 20082 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:06.133301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:50905 (local address 127.9.127.254:35017)
0811 10:03:06.133427 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:06.133429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:06.133438 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:03:06.133490 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:06.133490 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:06.133500 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:06.133567 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:06.133864 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.134355 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.134999 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.135180 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.135228 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:06.137646 (+ 2418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:50905: BlockingRecv error: recv got EOF from 127.9.127.193:50905 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":52,"threads_started":1}
Aug 11 10:03:06 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:06 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:06.262470 20083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:06.257965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:55605)
0811 10:03:06.258133 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:06.258144 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:06.258194 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:06.258335 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:06.258336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:06.258503 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:06.258555 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:06.258556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.259209 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.259210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:06.259764 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:06.259765 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.260130 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.260130 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:06.260171 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:06.260656 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:06.260661 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:06.262411 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
W20260811 10:03:06.262593 20082 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:06.258096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:55605 (local address 127.9.127.254:35017)
0811 10:03:06.258163 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:06.258165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:06.258177 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:03:06.258258 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:06.258258 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:06.258270 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:06.258322 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:06.258629 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.259140 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.259852 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.260059 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.260118 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:06.262507 (+ 2389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:55605: BlockingRecv error: recv got EOF from 127.9.127.194:55605 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 10:03:06 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:06 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:06.398164 20084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:06.393620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:51687)
0811 10:03:06.393763 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:06.393773 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:06.393827 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:06.393946 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:06.393947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:06.394101 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:06.394152 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:06.394154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.394729 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.394729 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:06.395202 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:06.395203 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.395491 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.395491 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:06.395527 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:06.396013 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:06.396018 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:06.398071 (+ 2053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
W20260811 10:03:06.398200 20082 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:06.393698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:51687 (local address 127.9.127.254:35017)
0811 10:03:06.393766 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:06.393768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:06.393829 (+ 61us) server_negotiation.cc:407] Connection header received
0811 10:03:06.393866 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:06.393866 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:06.393878 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:06.393928 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:06.394211 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.394664 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.395268 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:06.395430 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:06.395477 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:06.398143 (+ 2666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:51687: BlockingRecv error: recv got EOF from 127.9.127.195:51687 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 10:03:07 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:07 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:07.142954 20085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:07.138406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:39441)
0811 10:03:07.138562 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:07.138572 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:07.138633 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:07.138767 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:07.138768 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:07.138973 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:07.139040 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:07.139043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.139754 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.139755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:07.140273 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:07.140275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.140626 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.140627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:07.140691 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:07.141152 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:07.141157 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:07.142894 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
W20260811 10:03:07.143102 20086 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:07.138452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:39441 (local address 127.9.127.254:35017)
0811 10:03:07.138575 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:07.138577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:07.138619 (+ 42us) server_negotiation.cc:407] Connection header received
0811 10:03:07.138676 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:07.138676 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:07.138686 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:07.138740 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:07.139135 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.139668 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.140355 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.140553 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.140626 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:07.143006 (+ 2380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:39441: BlockingRecv error: recv got EOF from 127.9.127.193:39441 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
Aug 11 10:03:07 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:07 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:07.267731 20087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:07.263000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:44705)
0811 10:03:07.263162 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:07.263173 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:07.263228 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:07.263357 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:07.263358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:07.263531 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:07.263602 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:07.263604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.264205 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.264206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:07.264732 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:07.264733 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.265317 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.265318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:07.265372 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:07.266013 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:07.266018 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:07.267676 (+ 1658us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
W20260811 10:03:07.267830 20086 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:07.263095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:44705 (local address 127.9.127.254:35017)
0811 10:03:07.263154 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:07.263156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:07.263226 (+ 70us) server_negotiation.cc:407] Connection header received
0811 10:03:07.263274 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:07.263275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:07.263286 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:07.263339 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:07.263660 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.264141 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.265031 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.265239 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.265305 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:07.267764 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:44705: BlockingRecv error: recv got EOF from 127.9.127.194:44705 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 10:03:07 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:07 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:07.402984 20088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:07.398591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:36333)
0811 10:03:07.398753 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:07.398762 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:07.398832 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:07.398977 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:07.398978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:07.399174 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:07.399223 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:07.399226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.399866 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.399867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:07.400361 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:07.400363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.400703 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.400704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:07.400764 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:07.401195 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:07.401199 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:07.402925 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":97,"threads_started":1}
W20260811 10:03:07.403110 20086 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:07.398640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:36333 (local address 127.9.127.254:35017)
0811 10:03:07.398710 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:07.398712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:07.398818 (+ 106us) server_negotiation.cc:407] Connection header received
0811 10:03:07.398884 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:07.398884 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:07.398898 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:07.398957 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:07.399302 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.399785 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.400444 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:07.400630 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:07.400701 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:07.403011 (+ 2310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:36333: BlockingRecv error: recv got EOF from 127.9.127.195:36333 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 10:03:08 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:08 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:08.148139 20089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:08.143435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:55713)
0811 10:03:08.143603 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:08.143631 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:08.143685 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:08.143829 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:08.143830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:08.144023 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:08.144085 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:08.144087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.144956 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.144958 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:08.145452 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:08.145454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.145843 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.145845 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:08.145897 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:08.146296 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:08.146300 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:08.148068 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
W20260811 10:03:08.148221 20090 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:08.143529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:55713 (local address 127.9.127.254:35017)
0811 10:03:08.143691 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:08.143693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:08.143716 (+ 23us) server_negotiation.cc:407] Connection header received
0811 10:03:08.143738 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:08.143739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:08.143750 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:08.143807 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:08.144182 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.144853 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.145522 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.145694 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.145740 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:08.148150 (+ 2410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:55713: BlockingRecv error: recv got EOF from 127.9.127.193:55713 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
Aug 11 10:03:08 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:08 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:08.273144 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:08.268436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:33279)
0811 10:03:08.268637 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:08.268648 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:08.268726 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:08.268932 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:08.268933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:08.269094 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:08.269149 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:08.269151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.269752 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.269753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:08.270252 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:08.270253 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.270617 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.270618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:08.270696 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:08.271165 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:08.271170 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:08.273085 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":131,"threads_started":1}
W20260811 10:03:08.273273 20090 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:08.268494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:33279 (local address 127.9.127.254:35017)
0811 10:03:08.268562 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:08.268564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:08.268727 (+ 163us) server_negotiation.cc:407] Connection header received
0811 10:03:08.268829 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:08.268830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:08.268842 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:08.268900 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:08.269209 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.269687 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.270330 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.270549 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.270610 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:08.273172 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:33279: BlockingRecv error: recv got EOF from 127.9.127.194:33279 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 10:03:08 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:08 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:08.408172 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:08.403494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:34643)
0811 10:03:08.403697 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:08.403715 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:08.403806 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:08.403964 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:08.403965 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:08.404156 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:08.404208 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:08.404210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.404893 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.404894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:08.405404 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:08.405406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.405753 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.405754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:08.405796 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:08.406236 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:08.406241 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:08.408110 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":104,"threads_started":1}
W20260811 10:03:08.408304 20090 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:08.403587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:34643 (local address 127.9.127.254:35017)
0811 10:03:08.403664 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:08.403667 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:08.403810 (+ 143us) server_negotiation.cc:407] Connection header received
0811 10:03:08.403861 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:08.403861 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:08.403875 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:08.403927 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:08.404272 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.404748 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.405501 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:08.405687 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:08.405738 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:08.408201 (+ 2463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:34643: BlockingRecv error: recv got EOF from 127.9.127.195:34643 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 10:03:09 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:09 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:09.152997 20094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:09.148625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:39661)
0811 10:03:09.148854 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:09.148865 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:09.148914 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:09.149025 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:09.149026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:09.149192 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:09.149245 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:09.149246 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.149837 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.149838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:09.150347 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:09.150348 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.150671 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.150672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:09.150713 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:09.151126 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:09.151130 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:09.152938 (+ 1808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":158,"threads_started":1}
W20260811 10:03:09.153159 20095 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:09.148768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:39661 (local address 127.9.127.254:35017)
0811 10:03:09.148906 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:09.148908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:09.148916 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:03:09.148955 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:09.148955 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:09.148965 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:09.149020 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:09.149302 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.149776 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.150415 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.150609 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.150656 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:09.153046 (+ 2390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:39661: BlockingRecv error: recv got EOF from 127.9.127.193:39661 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
Aug 11 10:03:09 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:09 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:09.278374 20096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:09.273632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:39907)
0811 10:03:09.273822 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:09.273831 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:09.273883 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:09.274026 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:09.274026 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:09.274180 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:09.274234 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:09.274235 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.274924 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.274925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:09.275437 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:09.275438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.275749 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.275750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:09.275787 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:09.276357 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:09.276362 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:09.278310 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":112,"threads_started":1}
W20260811 10:03:09.278493 20095 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:09.273710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:39907 (local address 127.9.127.254:35017)
0811 10:03:09.273782 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:09.273784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:09.273881 (+ 97us) server_negotiation.cc:407] Connection header received
0811 10:03:09.273936 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:09.273937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:09.273949 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:09.273998 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:09.274288 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.274865 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.275502 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.275690 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.275735 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:09.278401 (+ 2666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:39907: BlockingRecv error: recv got EOF from 127.9.127.194:39907 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 10:03:09 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:09 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:09.413503 20098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:09.408650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:44847)
0811 10:03:09.408835 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:09.408848 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:09.408942 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:09.409119 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:09.409120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:09.409300 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:09.409350 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:09.409352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.410071 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.410072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:09.410634 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:09.410636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.411000 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.411001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:09.411061 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:09.411609 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:09.411613 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:09.413418 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":57,"threads_started":1}
W20260811 10:03:09.413618 20095 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:09.408872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:44847 (local address 127.9.127.254:35017)
0811 10:03:09.408945 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:09.408946 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:09.408956 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:03:09.409002 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:09.409003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:09.409020 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:09.409083 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:09.409430 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.409960 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.410744 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:09.410927 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:09.411001 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:09.413512 (+ 2511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:44847: BlockingRecv error: recv got EOF from 127.9.127.195:44847 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 10:03:10 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:10 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:10.158042 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:10.153508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:33693)
0811 10:03:10.153664 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:10.153675 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:10.153731 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:10.153872 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:10.153873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:10.154059 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:10.154121 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:10.154123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.154762 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.154763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:10.155297 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:10.155298 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.155671 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.155671 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:10.155713 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:10.156140 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:10.156144 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:10.157973 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
W20260811 10:03:10.158162 20100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:10.153600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:33693 (local address 127.9.127.254:35017)
0811 10:03:10.153699 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:10.153702 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:10.153721 (+ 19us) server_negotiation.cc:407] Connection header received
0811 10:03:10.153777 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:10.153777 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:10.153788 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:10.153855 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:10.154186 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.154696 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.155390 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.155597 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.155661 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:10.158088 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:33693: BlockingRecv error: recv got EOF from 127.9.127.193:33693 (error 108)
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":49,"threads_started":1}
Aug 11 10:03:10 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:10 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:10.283713 20101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:10.278957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:39475)
0811 10:03:10.279116 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:10.279128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:10.279198 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:10.279480 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:10.279481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:10.279695 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:10.279763 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:10.279765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.280410 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.280410 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:10.280966 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:10.280969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.281304 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.281305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:10.281350 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:10.281794 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:10.281799 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:10.283655 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
W20260811 10:03:10.283841 20100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:10.279011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:39475 (local address 127.9.127.254:35017)
0811 10:03:10.279061 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:10.279063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:10.279307 (+ 244us) server_negotiation.cc:407] Connection header received
0811 10:03:10.279342 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:10.279343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:10.279358 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:10.279422 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:10.279838 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.280330 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.281062 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.281238 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.281287 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:10.283753 (+ 2466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:39475: BlockingRecv error: recv got EOF from 127.9.127.194:39475 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 10:03:10 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:10 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:10.422179 20102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:10.413990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:36049)
0811 10:03:10.414135 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:10.414149 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:10.414205 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:10.414347 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:10.414348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:10.414511 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:10.414562 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:10.414564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.415172 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.415173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:10.415684 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:10.415686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.416030 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.416032 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:10.416083 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:10.420254 (+ 4171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:10.420259 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:10.422116 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
W20260811 10:03:10.422310 20100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:10.414096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:36049 (local address 127.9.127.254:35017)
0811 10:03:10.414160 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:10.414162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:10.414201 (+ 39us) server_negotiation.cc:407] Connection header received
0811 10:03:10.414262 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:10.414262 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:10.414275 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:10.414325 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:10.414641 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.415107 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.415765 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:10.415941 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:10.416014 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:10.422212 (+ 6198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:36049: BlockingRecv error: recv got EOF from 127.9.127.195:36049 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 10:03:11 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:11 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:11.163134 20103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:11.158682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:53363)
0811 10:03:11.158832 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:11.158842 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:11.158891 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:11.159041 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:11.159042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:11.159198 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:11.159251 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:11.159252 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.159891 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.159891 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:11.160389 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:11.160390 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.160762 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.160763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:11.160822 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:11.161335 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:11.161340 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:11.163077 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
W20260811 10:03:11.163297 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:11.158772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:53363 (local address 127.9.127.254:35017)
0811 10:03:11.158915 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:11.158917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:11.158925 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:03:11.158949 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:11.158949 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:11.158962 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:11.159027 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:11.159319 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.159823 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.160471 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.160691 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.160750 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:11.163197 (+ 2447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:53363: BlockingRecv error: recv got EOF from 127.9.127.193:53363 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
Aug 11 10:03:11 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:11 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:11.288678 20105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:11.284175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:37757)
0811 10:03:11.284340 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:11.284351 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:11.284434 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:11.284590 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:11.284591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:11.284821 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:11.284885 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:11.284887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.285533 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.285535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:11.286097 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:11.286098 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.286464 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.286465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:11.286523 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:11.286954 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:11.286959 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:11.288615 (+ 1656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
W20260811 10:03:11.288776 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:11.284258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:37757 (local address 127.9.127.254:35017)
0811 10:03:11.284324 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:11.284326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:11.284414 (+ 88us) server_negotiation.cc:407] Connection header received
0811 10:03:11.284492 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:11.284493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:11.284505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:11.284581 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:11.284962 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.285451 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.286184 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.286391 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.286466 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:11.288711 (+ 2245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:37757: BlockingRecv error: recv got EOF from 127.9.127.194:37757 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 10:03:11 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:11 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:11.427537 20106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:11.422743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:51433)
0811 10:03:11.422908 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:11.422920 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:11.422986 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:11.423131 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:11.423132 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:11.423301 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:11.423352 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:11.423354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.423992 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.423992 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:11.424757 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:11.424760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.425140 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.425141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:11.425183 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:11.425720 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:11.425725 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:11.427479 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
W20260811 10:03:11.427704 20104 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:11.422859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:51433 (local address 127.9.127.254:35017)
0811 10:03:11.422931 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:11.422932 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:11.422987 (+ 55us) server_negotiation.cc:407] Connection header received
0811 10:03:11.423042 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:11.423043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:11.423055 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:11.423097 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:11.423416 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.423920 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.424873 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:11.425074 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:11.425126 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:11.427627 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:51433: BlockingRecv error: recv got EOF from 127.9.127.195:51433 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 10:03:12 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:12 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:12.167867 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:12.163614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:42099)
0811 10:03:12.163811 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:12.163825 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:12.163897 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:12.164027 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:12.164028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:12.164197 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:12.164244 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:12.164246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.164902 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.164903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:12.165426 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:12.165427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.165742 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.165743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:12.165783 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:12.166191 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:12.166196 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:12.167804 (+ 1608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":114,"threads_started":1}
W20260811 10:03:12.167964 20108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:12.163720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:42099 (local address 127.9.127.254:35017)
0811 10:03:12.163827 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:12.163829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:12.163890 (+ 61us) server_negotiation.cc:407] Connection header received
0811 10:03:12.163942 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:12.163943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:12.163954 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:12.164011 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:12.164311 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.164841 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.165497 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.165681 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.165728 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:12.167892 (+ 2164us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:42099: BlockingRecv error: recv got EOF from 127.9.127.193:42099 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":54,"threads_started":1}
Aug 11 10:03:12 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:12 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:12.293898 20109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:12.289164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:60291)
0811 10:03:12.289329 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:12.289340 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:12.289433 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:12.289572 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:12.289574 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:12.289776 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:12.289823 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:12.289825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.290511 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.290513 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:12.291059 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:12.291061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.291427 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.291428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:12.291492 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:12.291977 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:12.291988 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:12.293790 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":82,"threads_started":1}
W20260811 10:03:12.293944 20108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:12.289237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:60291 (local address 127.9.127.254:35017)
0811 10:03:12.289314 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:12.289317 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:12.289408 (+ 91us) server_negotiation.cc:407] Connection header received
0811 10:03:12.289485 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:12.289486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:12.289500 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:12.289563 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:12.289910 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.290429 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.291143 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.291334 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.291423 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:12.293866 (+ 2443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:60291: BlockingRecv error: recv got EOF from 127.9.127.194:60291 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 11 10:03:12 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:12 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:12.433123 20110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:12.428029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:34499)
0811 10:03:12.428262 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:12.428277 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:12.428357 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:12.428544 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:12.428545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:12.428740 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:12.428814 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:12.428816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.429449 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.429450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:12.430086 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:12.430089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.430469 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.430470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:12.430552 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:12.430982 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:12.430986 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:12.433048 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":121,"threads_started":1}
W20260811 10:03:12.433311 20108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:12.428071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:34499 (local address 127.9.127.254:35017)
0811 10:03:12.428141 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:12.428143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:12.428360 (+ 217us) server_negotiation.cc:407] Connection header received
0811 10:03:12.428415 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:12.428415 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:12.428432 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:12.428517 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:12.428872 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.429372 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.430162 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:12.430401 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:12.430455 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:12.433246 (+ 2791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:34499: BlockingRecv error: recv got EOF from 127.9.127.195:34499 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 10:03:13 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:13 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:13.173283 20111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:13.168481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:39573)
0811 10:03:13.168611 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:13.168620 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:13.168663 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:13.168874 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:13.168875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:13.169049 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:13.169101 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:13.169103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.169721 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.169722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:13.170311 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:13.170314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.170813 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.170814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:13.170887 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:13.171328 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:13.171333 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:13.173217 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":57,"threads_started":1}
W20260811 10:03:13.173401 20112 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:13.168566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:39573 (local address 127.9.127.254:35017)
0811 10:03:13.168705 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:13.168707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:13.168715 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:03:13.168737 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:13.168738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:13.168748 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:13.168825 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:13.169166 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.169655 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.170386 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.170734 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.170801 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:13.173316 (+ 2515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:39573: BlockingRecv error: recv got EOF from 127.9.127.193:39573 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
Aug 11 10:03:13 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:13 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:13.299060 20114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:13.294509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:56995)
0811 10:03:13.294697 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:13.294709 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:13.294798 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:13.294923 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:13.294924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:13.295114 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:13.295160 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:13.295162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.295839 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.295840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:13.296387 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:13.296390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.296808 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.296809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:13.296876 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:13.297297 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:13.297302 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:13.299007 (+ 1705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":99,"threads_started":1}
W20260811 10:03:13.299156 20112 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:13.294628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:56995 (local address 127.9.127.254:35017)
0811 10:03:13.294701 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:13.294703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:13.294779 (+ 76us) server_negotiation.cc:407] Connection header received
0811 10:03:13.294855 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:13.294856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:13.294869 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:13.294919 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:13.295241 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.295754 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.296476 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.296697 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.296808 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:13.299095 (+ 2287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:56995: BlockingRecv error: recv got EOF from 127.9.127.194:56995 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 11 10:03:13 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:13 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:13.438192 20115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:13.433590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:33133)
0811 10:03:13.433752 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:13.433762 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:13.433818 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:13.433950 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:13.433951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:13.434144 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:13.434201 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:13.434202 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.434837 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.434837 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:13.435357 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:13.435359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.435710 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.435711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:13.435751 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:13.436182 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:13.436187 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:13.438132 (+ 1945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
W20260811 10:03:13.438318 20112 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:13.433667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:33133 (local address 127.9.127.254:35017)
0811 10:03:13.433736 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:13.433737 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:13.433818 (+ 81us) server_negotiation.cc:407] Connection header received
0811 10:03:13.433873 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:13.433874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:13.433886 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:13.433929 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:13.434286 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.434770 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.435426 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:13.435633 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:13.435696 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:13.438219 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:33133: BlockingRecv error: recv got EOF from 127.9.127.195:33133 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 10:03:14 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:14 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:14.178117 20116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:14.173771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:42479)
0811 10:03:14.173909 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:14.173919 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:14.173976 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:14.174117 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:14.174118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:14.174283 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:14.174332 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:14.174333 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.174924 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.174925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:14.175439 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:14.175441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.175822 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.175823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:14.175864 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:14.176292 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:14.176296 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:14.178052 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
W20260811 10:03:14.178233 20117 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:14.173834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:42479 (local address 127.9.127.254:35017)
0811 10:03:14.173937 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:14.173939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:14.173966 (+ 27us) server_negotiation.cc:407] Connection header received
0811 10:03:14.174028 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:14.174029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:14.174039 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:14.174102 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:14.174392 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.174864 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.175542 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.175748 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.175811 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:14.178152 (+ 2341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:42479: BlockingRecv error: recv got EOF from 127.9.127.193:42479 (error 108)
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":49,"threads_started":1}
Aug 11 10:03:14 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:14 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:14.304270 20118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:14.299551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:42647)
0811 10:03:14.299711 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:14.299724 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:14.299785 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:14.299935 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:14.299936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:14.300118 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:14.300170 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:14.300171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.300830 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.300834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:14.301351 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:14.301352 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.301672 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.301672 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:14.301711 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:14.302327 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:14.302334 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:14.304203 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":75,"threads_started":1}
W20260811 10:03:14.304337 20117 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:14.299695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:42647 (local address 127.9.127.254:35017)
0811 10:03:14.299757 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:14.299759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:14.299771 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:03:14.299853 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:14.299854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:14.299865 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:14.299915 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:14.300232 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.300721 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.301419 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.301609 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.301659 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:14.304289 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:42647: BlockingRecv error: recv got EOF from 127.9.127.194:42647 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 10:03:14 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:14 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:14.443109 20120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:14.438662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:40251)
0811 10:03:14.438789 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:14.438801 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:14.438864 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:14.439015 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:14.439015 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:14.439176 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:14.439225 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:14.439227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.439824 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.439825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:14.440281 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:14.440282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.440586 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.440586 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:14.440622 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:14.441304 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:14.441309 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:14.443045 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":58,"threads_started":1}
W20260811 10:03:14.443219 20117 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:14.438751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:40251 (local address 127.9.127.254:35017)
0811 10:03:14.438832 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:14.438834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:14.438847 (+ 13us) server_negotiation.cc:407] Connection header received
0811 10:03:14.438929 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:14.438930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:14.438944 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:14.438995 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:14.439286 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.439761 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.440348 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:14.440517 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:14.440569 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:14.443143 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:40251: BlockingRecv error: recv got EOF from 127.9.127.195:40251 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 10:03:15 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:15 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:15.182972 20121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:15.178669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:36811)
0811 10:03:15.178840 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:15.178851 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:15.178906 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:15.179048 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:15.179049 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:15.179228 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:15.179280 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:15.179282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.179910 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.179911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:15.180425 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:15.180427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.180729 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.180730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:15.180770 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:15.181209 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:15.181214 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:15.182911 (+ 1697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
W20260811 10:03:15.183115 20122 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:15.178766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:36811 (local address 127.9.127.254:35017)
0811 10:03:15.178891 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:15.178893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:15.178902 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:03:15.178961 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:15.178961 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:15.178972 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:15.179030 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:15.179350 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.179848 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.180495 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.180669 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.180714 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:15.183005 (+ 2291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:36811: BlockingRecv error: recv got EOF from 127.9.127.193:36811 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":70,"threads_started":1}
Aug 11 10:03:15 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:15 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:15.309142 20123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:15.304786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:39169)
0811 10:03:15.304966 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:15.304978 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:15.305044 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:15.305172 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:15.305173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:15.305342 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:15.305401 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:15.305402 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.306030 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.306031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:15.306544 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:15.306546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.306858 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.306859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:15.306903 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:15.307333 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:15.307338 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:15.309088 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":77,"threads_started":1}
W20260811 10:03:15.309207 20122 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:15.304979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:39169 (local address 127.9.127.254:35017)
0811 10:03:15.305041 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:15.305043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:15.305076 (+ 33us) server_negotiation.cc:407] Connection header received
0811 10:03:15.305098 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:15.305099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:15.305109 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:15.305146 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:15.305464 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.305942 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.306618 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.306793 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.306839 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:15.309163 (+ 2324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:39169: BlockingRecv error: recv got EOF from 127.9.127.194:39169 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 10:03:15 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:15 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.195@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:15.452625 20124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:15.443570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.195:52431)
0811 10:03:15.443750 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:15.443762 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:15.443851 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:15.444006 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:15.444007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:15.444212 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:15.444263 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:15.444265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.445015 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.445016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:15.445610 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:15.445612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.445989 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.445989 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:15.446046 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:15.450881 (+ 4835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:15.450886 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:15.452536 (+ 1650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
W20260811 10:03:15.452666 20122 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:15.443653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:52431 (local address 127.9.127.254:35017)
0811 10:03:15.443733 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:15.443735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:15.443834 (+ 99us) server_negotiation.cc:407] Connection header received
0811 10:03:15.443907 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:15.443908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:15.443924 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:15.443997 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:15.444348 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.444926 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.445705 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:15.445917 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:15.445990 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:15.452607 (+ 6617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.195:52431: BlockingRecv error: recv got EOF from 127.9.127.195:52431 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 10:03:16 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:16 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.193@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:16.188200 20125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.183535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.193:42451)
0811 10:03:16.183687 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:16.183697 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:16.183745 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:16.183891 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:16.183892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:16.184061 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:16.184112 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.184114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.184820 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.184821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.185365 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.185367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.185695 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.185695 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.185738 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.186180 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:16.186184 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:16.188072 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
W20260811 10:03:16.188278 20126 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:16.183630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:42451 (local address 127.9.127.254:35017)
0811 10:03:16.183766 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:16.183768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:16.183775 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:03:16.183798 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:16.183798 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:16.183809 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:16.183873 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:16.184182 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.184700 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.185439 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.185629 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.185679 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.188196 (+ 2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.193:42451: BlockingRecv error: recv got EOF from 127.9.127.193:42451 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
Aug 11 10:03:16 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 10:03:16 dist-test-slave-1x4g krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.9.127.194@KRBTEST.COM for oryx/127.9.127.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 10:03:16.314122 20127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.309765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35017 (local address 127.9.127.194:47035)
0811 10:03:16.309906 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:16.309917 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:16.309982 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:16.310112 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:16.310113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:16.310293 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:16.310348 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.310349 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.311009 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.311010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.311544 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.311545 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.311871 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.311872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.311911 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.312369 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:16.312374 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:16.314045 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.9.127.254:35017: Server oryx/127.9.127.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
W20260811 10:03:16.314230 20126 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:16.309818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:47035 (local address 127.9.127.254:35017)
0811 10:03:16.309888 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:16.309890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:16.310000 (+ 110us) server_negotiation.cc:407] Connection header received
0811 10:03:16.310027 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:16.310028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:16.310038 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:16.310085 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:16.310413 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.310942 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.311613 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.311797 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.311857 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.314136 (+ 2279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.9.127.194:47035: BlockingRecv error: recv got EOF from 127.9.127.194:47035 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:03:16.358474 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 19592
I20260811 10:03:16.367143 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 19764
I20260811 10:03:16.372876 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 19911
I20260811 10:03:16.378223 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 19513
2026-08-11T10:03:16Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17459 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T10:03:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:03:16Z Disabled control of system clock
I20260811 10:03:16.408413 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37349
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:37349
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 10:03:16.487003 20132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:16.487229 20132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:16.487262 20132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:16.488369 20132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:03:16.488435 20132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:16.488456 20132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:16.488480 20132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:03:16.488511 20132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:03:16.489843 20132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:37349
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:16.490111 20132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:16.490386 20132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:16.495221 20137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:16.495272 20141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:16.495234 20139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:16.495301 20132 server_base.cc:1034] running on GCE node
I20260811 10:03:16.495766 20132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:16.496031 20132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:16.497200 20132 hybrid_clock.cc:648] HybridClock initialized: now 1786442596497191 us; error 26 us; skew 500 ppm
I20260811 10:03:16.498348 20132 webserver.cc:460] Webserver started at http://127.9.127.254:35721/ using document root <none> and password file <none>
I20260811 10:03:16.498591 20132 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:16.498660 20132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:16.498809 20132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:16.499855 20132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "c4491a9912b24b338347995f2997a827"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "9b435989eeeb90b9285bbed85eac5b1c"
server_key_iv: "0a615c12433ed6b8ee5c7fb24b0dd8ba"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.500211 20132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "c4491a9912b24b338347995f2997a827"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "9b435989eeeb90b9285bbed85eac5b1c"
server_key_iv: "0a615c12433ed6b8ee5c7fb24b0dd8ba"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.501585 20132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:03:16.502290 20148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.502451 20132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:03:16.502554 20132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "c4491a9912b24b338347995f2997a827"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "9b435989eeeb90b9285bbed85eac5b1c"
server_key_iv: "0a615c12433ed6b8ee5c7fb24b0dd8ba"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.502631 20132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:16.516464 20132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:16.516767 20132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:16.517004 20132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:16.520975 20132 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:37349
I20260811 10:03:16.521004 20208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:37349 every 8 connection(s)
I20260811 10:03:16.521307 20132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:03:16.521906 20209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:03:16.522306 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 20132
I20260811 10:03:16.522442 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:03:16.522676 9727 external_mini_cluster.cc:1428] Setting key b16973a3c4c1ba93027194f274867136
I20260811 10:03:16.525494 20209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827: Bootstrap starting.
I20260811 10:03:16.526188 20209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827: Neither blocks nor log segments found. Creating new log.
I20260811 10:03:16.526494 20209 log.cc:824] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827: Log is configured to *not* fsync() on all Append() calls
I20260811 10:03:16.527225 20209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827: No bootstrap required, opened a new log
I20260811 10:03:16.528192 20212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.523259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54748 (local address 127.9.127.254:37349)
0811 10:03:16.523452 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:16.523458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:16.523481 (+ 23us) server_negotiation.cc:407] Connection header received
0811 10:03:16.523899 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:16.523906 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:16.523961 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:16.524066 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:16.524305 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.525240 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.526292 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.526749 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.526846 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.527561 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:16.527564 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:16.527564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:03:16.527738 (+ 174us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:16.527778 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:03:16.527787 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:16.527832 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:16.527926 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 10:03:16.527997 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260811 10:03:16.529455 20209 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4491a9912b24b338347995f2997a827" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37349 } }
I20260811 10:03:16.529606 20209 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:03:16.529654 20209 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4491a9912b24b338347995f2997a827, State: Initialized, Role: FOLLOWER
I20260811 10:03:16.529791 20209 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4491a9912b24b338347995f2997a827" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37349 } }
I20260811 10:03:16.529870 20209 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:03:16.529913 20209 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:03:16.529960 20209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:03:16.530573 20209 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4491a9912b24b338347995f2997a827" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37349 } }
I20260811 10:03:16.530691 20209 leader_election.cc:302] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4491a9912b24b338347995f2997a827; no voters:
I20260811 10:03:16.530850 20209 leader_election.cc:288] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:03:16.530884 20214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:03:16.531060 20214 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [term 1 LEADER]: Becoming Leader. State: Replica: c4491a9912b24b338347995f2997a827, State: Running, Role: LEADER
I20260811 10:03:16.531100 20209 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:03:16.531177 20214 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4491a9912b24b338347995f2997a827" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37349 } }
I20260811 10:03:16.531596 20215 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4491a9912b24b338347995f2997a827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4491a9912b24b338347995f2997a827" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37349 } } }
I20260811 10:03:16.531601 20217 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4491a9912b24b338347995f2997a827. Latest consensus state: current_term: 1 leader_uuid: "c4491a9912b24b338347995f2997a827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4491a9912b24b338347995f2997a827" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37349 } } }
I20260811 10:03:16.531826 20217 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:16.532039 20215 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:16.532090 20225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:03:16.532560 20225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:03:16.534027 20225 catalog_manager.cc:1347] Generated new cluster ID: a6e4238e7a0d45e7b34d006adb9164db
I20260811 10:03:16.534089 20225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:03:16.547199 20225 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:03:16.547659 20225 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:03:16.550599 20225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4491a9912b24b338347995f2997a827: Generated new TSK 0
I20260811 10:03:16.550767 20225 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:03:16.560456 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37349
--builtin_ntp_servers=127.9.127.212:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 10:03:16.658031 20235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:16.658252 20235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:16.658285 20235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:16.659410 20235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:16.659472 20235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:16.659531 20235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:03:16.660840 20235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:16.661074 20235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:16.661365 20235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:16.666239 20241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:16.666230 20242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:16.666363 20244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:16.666409 20235 server_base.cc:1034] running on GCE node
I20260811 10:03:16.666697 20235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:16.666950 20235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:16.668120 20235 hybrid_clock.cc:648] HybridClock initialized: now 1786442596668106 us; error 32 us; skew 500 ppm
I20260811 10:03:16.669406 20235 webserver.cc:460] Webserver started at http://127.9.127.193:39347/ using document root <none> and password file <none>
I20260811 10:03:16.669641 20235 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:16.669713 20235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:16.669849 20235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:16.670871 20235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "b2adb121793646b29c1ccdd61a0476bb"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "254b653c0a16bd3fa090deb45288c20a"
server_key_iv: "747a0cb78af34bc1612e1f66cc48d9ae"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.671224 20235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "b2adb121793646b29c1ccdd61a0476bb"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "254b653c0a16bd3fa090deb45288c20a"
server_key_iv: "747a0cb78af34bc1612e1f66cc48d9ae"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.672586 20235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:03:16.673498 20251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.673669 20235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:03:16.673766 20235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "b2adb121793646b29c1ccdd61a0476bb"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "254b653c0a16bd3fa090deb45288c20a"
server_key_iv: "747a0cb78af34bc1612e1f66cc48d9ae"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.673844 20235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:16.686002 20235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:16.686269 20235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:16.686408 20235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:16.686625 20235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:16.686937 20235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:16.686991 20235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.687031 20235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:16.687058 20235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.692636 20235 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:44427
I20260811 10:03:16.692708 20379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:44427 every 8 connection(s)
I20260811 10:03:16.693045 20235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:03:16.696722 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 20235
I20260811 10:03:16.696857 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:03:16.697083 9727 external_mini_cluster.cc:1428] Setting key 0f614f16203c97158abaf49e78a2e820
I20260811 10:03:16.698132 20212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.693817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:53695 (local address 127.9.127.254:37349)
0811 10:03:16.693897 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:16.693900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:16.694097 (+ 197us) server_negotiation.cc:407] Connection header received
0811 10:03:16.694545 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:16.694546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:16.694559 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:16.694614 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:16.695169 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.695634 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.696541 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.696903 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.696980 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.697879 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:16.697880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:16.697880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:03:16.697885 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:16.697902 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:03:16.697906 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:16.697965 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:16.698057 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 10:03:16.698076 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 10:03:16.698201 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37349
--builtin_ntp_servers=127.9.127.212:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 10:03:16.698410 20382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.693789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37349 (local address 127.9.127.193:53695)
0811 10:03:16.693984 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:16.694015 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:16.694470 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:16.694660 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:16.694663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:16.694670 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:16.695105 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.695109 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.695713 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.695714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.696442 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.696444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.696997 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.696998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.697128 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.697705 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:03:16.697706 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:16.697744 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:03:16.697773 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:16.697973 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:16.697980 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:16.697982 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:03:16.698061 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 10:03:16.698192 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260811 10:03:16.698884 20380 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37349
I20260811 10:03:16.698963 20380 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:16.699159 20380 heartbeater.cc:511] Master 127.9.127.254:37349 requested a full tablet report, sending...
I20260811 10:03:16.699677 20166 ts_manager.cc:194] Registered new tserver with Master: b2adb121793646b29c1ccdd61a0476bb (127.9.127.193:44427)
I20260811 10:03:16.700541 20166 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.193:53695
W20260811 10:03:16.778888 20383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:16.779076 20383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:16.779096 20383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:16.780150 20383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:16.780182 20383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:16.780205 20383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:03:16.781549 20383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:16.781741 20383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:16.781971 20383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:16.786821 20390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:16.787014 20383 server_base.cc:1034] running on GCE node
W20260811 10:03:16.786815 20391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:16.786815 20393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:16.787367 20383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:16.787609 20383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:16.788767 20383 hybrid_clock.cc:648] HybridClock initialized: now 1786442596788751 us; error 29 us; skew 500 ppm
I20260811 10:03:16.789996 20383 webserver.cc:460] Webserver started at http://127.9.127.194:39963/ using document root <none> and password file <none>
I20260811 10:03:16.790261 20383 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:16.790328 20383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:16.790473 20383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:16.791472 20383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "3a3bcbacabf643b683f1fc56d892b2ce"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "5b4b6d1fc15b0aefa2cfbc2fdd56613c"
server_key_iv: "e50c9355ecdba0418102fab11a4aca64"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.791831 20383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "3a3bcbacabf643b683f1fc56d892b2ce"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "5b4b6d1fc15b0aefa2cfbc2fdd56613c"
server_key_iv: "e50c9355ecdba0418102fab11a4aca64"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.793147 20383 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:03:16.793877 20400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.794037 20383 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:03:16.794147 20383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "3a3bcbacabf643b683f1fc56d892b2ce"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "5b4b6d1fc15b0aefa2cfbc2fdd56613c"
server_key_iv: "e50c9355ecdba0418102fab11a4aca64"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.794221 20383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:16.820050 20383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:16.820343 20383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:16.820489 20383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:16.820719 20383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:16.821069 20383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:16.821125 20383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.821165 20383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:16.821192 20383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.827167 20383 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:37033
I20260811 10:03:16.827234 20524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:37033 every 8 connection(s)
I20260811 10:03:16.827636 20383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:03:16.834395 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 20383
I20260811 10:03:16.834548 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:03:16.834760 9727 external_mini_cluster.cc:1428] Setting key 71614735eb7120c588e59605f77c4b16
I20260811 10:03:16.835340 20212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.829463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:41381 (local address 127.9.127.254:37349)
0811 10:03:16.829509 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:16.829511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:16.829853 (+ 342us) server_negotiation.cc:407] Connection header received
0811 10:03:16.830378 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:16.830379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:16.830393 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:16.830455 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:16.831169 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.831923 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.833249 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.833589 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.833676 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.834906 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:16.834908 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:16.834934 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:03:16.834941 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:16.834959 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:03:16.834964 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:16.835034 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:16.835172 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 10:03:16.835228 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:03:16.835536 20528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.829456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37349 (local address 127.9.127.194:41381)
0811 10:03:16.829684 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:16.829752 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:16.830274 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:16.830524 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:16.830527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:16.830537 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:16.831071 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.831076 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.832065 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.832067 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.833157 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.833161 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.833690 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.833691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.833837 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.834703 (+ 866us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:03:16.834704 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:16.834757 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:03:16.834787 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:16.835063 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:16.835071 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:16.835074 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:03:16.835169 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 10:03:16.835273 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
I20260811 10:03:16.835791 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37349
--builtin_ntp_servers=127.9.127.212:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 10:03:16.836333 20526 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37349
I20260811 10:03:16.836455 20526 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:16.836666 20526 heartbeater.cc:511] Master 127.9.127.254:37349 requested a full tablet report, sending...
I20260811 10:03:16.837133 20166 ts_manager.cc:194] Registered new tserver with Master: 3a3bcbacabf643b683f1fc56d892b2ce (127.9.127.194:37033)
I20260811 10:03:16.837517 20166 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.194:41381
W20260811 10:03:16.917364 20529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:16.917550 20529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:16.917572 20529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:16.918690 20529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:16.918730 20529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:16.918776 20529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:03:16.920027 20529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:16.920246 20529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:16.920542 20529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:16.925429 20534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:16.925562 20529 server_base.cc:1034] running on GCE node
W20260811 10:03:16.925467 20535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:16.925428 20537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:16.925928 20529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:16.926122 20529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:16.927253 20529 hybrid_clock.cc:648] HybridClock initialized: now 1786442596927231 us; error 40 us; skew 500 ppm
I20260811 10:03:16.928530 20529 webserver.cc:460] Webserver started at http://127.9.127.195:33881/ using document root <none> and password file <none>
I20260811 10:03:16.928766 20529 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:16.928866 20529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:16.928982 20529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:16.929949 20529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "ac0b76c5953e4520b1fab702eb6bf6f2"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "e725a19dfa2ecdba1fca0e14b534366b"
server_key_iv: "10004b179dc3580fd6803e7fe417780e"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.930297 20529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "ac0b76c5953e4520b1fab702eb6bf6f2"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "e725a19dfa2ecdba1fca0e14b534366b"
server_key_iv: "10004b179dc3580fd6803e7fe417780e"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.931780 20529 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:03:16.932564 20546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.932736 20529 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:03:16.932848 20529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "ac0b76c5953e4520b1fab702eb6bf6f2"
format_stamp: "Formatted at 2026-08-11 10:03:16 on dist-test-slave-1x4g"
server_key: "e725a19dfa2ecdba1fca0e14b534366b"
server_key_iv: "10004b179dc3580fd6803e7fe417780e"
server_key_version: "encryptionkey@0"
I20260811 10:03:16.932912 20529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:16.956769 20529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:16.957073 20529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:16.957171 20529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:16.957340 20529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:16.957605 20529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:16.957635 20529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.957656 20529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:16.957669 20529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:16.963171 20529 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:41621
I20260811 10:03:16.963217 20673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:41621 every 8 connection(s)
I20260811 10:03:16.963541 20529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:03:16.968341 20212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.964274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:37291 (local address 127.9.127.254:37349)
0811 10:03:16.964351 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:16.964359 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:16.964587 (+ 228us) server_negotiation.cc:407] Connection header received
0811 10:03:16.965111 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:16.965112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:16.965122 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:16.965179 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:16.965780 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.966259 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.967163 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.967347 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.967396 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.968126 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:16.968128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:16.968128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:03:16.968133 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:16.968147 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:03:16.968151 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:16.968198 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:16.968261 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 10:03:16.968283 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:03:16.968520 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:16.964262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37349 (local address 127.9.127.195:37291)
0811 10:03:16.964462 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:16.964513 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:16.965026 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:16.965229 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:16.965232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:16.965240 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:16.965713 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.965718 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.966336 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.966336 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.967074 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:16.967076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:16.967417 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:16.967418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:16.967538 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:16.967997 (+ 459us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:03:16.967997 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:16.968024 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:03:16.968046 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:16.968200 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:16.968202 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:16.968204 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:03:16.968249 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 10:03:16.968324 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
I20260811 10:03:16.969084 20675 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37349
I20260811 10:03:16.969161 20675 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:16.969295 20675 heartbeater.cc:511] Master 127.9.127.254:37349 requested a full tablet report, sending...
I20260811 10:03:16.969622 20166 ts_manager.cc:194] Registered new tserver with Master: ac0b76c5953e4520b1fab702eb6bf6f2 (127.9.127.195:41621)
I20260811 10:03:16.969940 20166 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.195:37291
I20260811 10:03:16.971562 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 20529
I20260811 10:03:16.971680 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:03:16.971892 9727 external_mini_cluster.cc:1428] Setting key cd0f8bb7d004e79035e0243e9f1e1c41
I20260811 10:03:16.972852 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 10:03:16.974668 20212 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:16.974136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54750 (local address 127.9.127.254:37349)
0811 10:03:16.974220 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:16.974222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:16.974359 (+ 137us) server_negotiation.cc:407] Connection header received
0811 10:03:16.974432 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:16.974433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:16.974443 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:16.974490 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:16.974609 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54750: BlockingRecv error: recv got EOF from 127.0.0.1:54750 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 10:03:16.974737 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 20235
I20260811 10:03:16.985416 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 20383
I20260811 10:03:16.990375 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 20529
I20260811 10:03:16.997951 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 20132
2026-08-11T10:03:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (617 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T10:03:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:03:17Z Disabled control of system clock
I20260811 10:03:17.025988 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:45529
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:46269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:45529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 10:03:17.106060 20688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:17.106238 20688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:17.106257 20688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:17.107213 20688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:03:17.107244 20688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:17.107255 20688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:17.107266 20688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:03:17.107277 20688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:03:17.108402 20688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:45529
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:45529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:17.108569 20688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:17.108819 20688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:17.113376 20697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:17.113397 20694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:17.113384 20695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:17.113771 20688 server_base.cc:1034] running on GCE node
I20260811 10:03:17.114008 20688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:17.114259 20688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:17.115432 20688 hybrid_clock.cc:648] HybridClock initialized: now 1786442597115421 us; error 24 us; skew 500 ppm
I20260811 10:03:17.116600 20688 webserver.cc:460] Webserver started at http://127.9.127.254:43291/ using document root <none> and password file <none>
I20260811 10:03:17.116894 20688 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:17.116962 20688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:17.117130 20688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:17.118160 20688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "359d13e9647b4816b5c257bae15b7162"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "f016c2a743b77ca3a4403cac51b24c1c"
server_key_iv: "bec8170494e24f4707acca7a895a7264"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.118516 20688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "359d13e9647b4816b5c257bae15b7162"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "f016c2a743b77ca3a4403cac51b24c1c"
server_key_iv: "bec8170494e24f4707acca7a895a7264"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.119753 20688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:03:17.120433 20706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.120610 20688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:03:17.120708 20688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "359d13e9647b4816b5c257bae15b7162"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "f016c2a743b77ca3a4403cac51b24c1c"
server_key_iv: "bec8170494e24f4707acca7a895a7264"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.120824 20688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:17.124080 20688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:17.124341 20688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:17.124483 20688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:17.128410 20688 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:45529
I20260811 10:03:17.128440 20767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:45529 every 8 connection(s)
I20260811 10:03:17.128741 20688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:03:17.129386 20769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:03:17.130162 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 20688
I20260811 10:03:17.130265 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:03:17.130458 9727 external_mini_cluster.cc:1428] Setting key da3ce88d699d56898e6a16867b986636
I20260811 10:03:17.132819 20769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162: Bootstrap starting.
I20260811 10:03:17.133008 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:17.130960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60852 (local address 127.9.127.254:45529)
0811 10:03:17.131167 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:17.131175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:17.131206 (+ 31us) server_negotiation.cc:407] Connection header received
0811 10:03:17.131724 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:17.131733 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:17.131782 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:17.131937 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:17.132534 (+ 597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:17.132538 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:17.132538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:03:17.132543 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:17.132588 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:03:17.132602 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:17.132678 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:17.132739 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 10:03:17.132808 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
I20260811 10:03:17.133549 20769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162: Neither blocks nor log segments found. Creating new log.
I20260811 10:03:17.133849 20769 log.cc:824] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162: Log is configured to *not* fsync() on all Append() calls
I20260811 10:03:17.134514 20769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162: No bootstrap required, opened a new log
I20260811 10:03:17.135790 20769 raft_consensus.cc:348] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "359d13e9647b4816b5c257bae15b7162" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45529 } }
I20260811 10:03:17.135913 20769 raft_consensus.cc:374] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:03:17.135933 20769 raft_consensus.cc:729] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 359d13e9647b4816b5c257bae15b7162, State: Initialized, Role: FOLLOWER
I20260811 10:03:17.136071 20769 consensus_queue.cc:260] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "359d13e9647b4816b5c257bae15b7162" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45529 } }
I20260811 10:03:17.136157 20769 raft_consensus.cc:388] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:03:17.136200 20769 raft_consensus.cc:482] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:03:17.136246 20769 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:03:17.137238 20769 raft_consensus.cc:504] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "359d13e9647b4816b5c257bae15b7162" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45529 } }
I20260811 10:03:17.137356 20769 leader_election.cc:302] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 359d13e9647b4816b5c257bae15b7162; no voters:
I20260811 10:03:17.137533 20769 leader_election.cc:288] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:03:17.137604 20774 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:03:17.137805 20774 raft_consensus.cc:686] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [term 1 LEADER]: Becoming Leader. State: Replica: 359d13e9647b4816b5c257bae15b7162, State: Running, Role: LEADER
I20260811 10:03:17.137856 20769 sys_catalog.cc:564] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:03:17.138083 20774 consensus_queue.cc:237] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "359d13e9647b4816b5c257bae15b7162" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45529 } }
I20260811 10:03:17.138451 20775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "359d13e9647b4816b5c257bae15b7162" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "359d13e9647b4816b5c257bae15b7162" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45529 } } }
I20260811 10:03:17.138566 20775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:17.138459 20776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 359d13e9647b4816b5c257bae15b7162. Latest consensus state: current_term: 1 leader_uuid: "359d13e9647b4816b5c257bae15b7162" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "359d13e9647b4816b5c257bae15b7162" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 45529 } } }
I20260811 10:03:17.138784 20776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:17.139197 20783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:03:17.139659 20783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:03:17.141081 20783 catalog_manager.cc:1347] Generated new cluster ID: 4c36762494504c60af3d3071ae90badf
I20260811 10:03:17.141134 20783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:03:17.147564 20783 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:03:17.147714 20783 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:03:17.151228 20783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 359d13e9647b4816b5c257bae15b7162: Generated new TSK 0
I20260811 10:03:17.151423 20783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:03:17.157929 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45529
--builtin_ntp_servers=127.9.127.212:46269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 10:03:17.240031 20794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:17.240253 20794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:17.240289 20794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:17.241495 20794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:17.241554 20794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:17.241596 20794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:03:17.242903 20794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:17.243172 20794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:17.243458 20794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:17.249002 20800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:17.249037 20802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:17.249015 20799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:17.249457 20794 server_base.cc:1034] running on GCE node
I20260811 10:03:17.249665 20794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:17.249915 20794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:17.251099 20794 hybrid_clock.cc:648] HybridClock initialized: now 1786442597251093 us; error 32 us; skew 500 ppm
I20260811 10:03:17.252545 20794 webserver.cc:460] Webserver started at http://127.9.127.193:43341/ using document root <none> and password file <none>
I20260811 10:03:17.252815 20794 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:17.252872 20794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:17.253005 20794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:17.254541 20794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "5805e1baf8de4a13a3a380e2b34fcbba"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "70a473f044088a9320a47515d78d6dd1"
server_key_iv: "87021db4450a45d4dca3dc982f6bab8e"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.255059 20794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "5805e1baf8de4a13a3a380e2b34fcbba"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "70a473f044088a9320a47515d78d6dd1"
server_key_iv: "87021db4450a45d4dca3dc982f6bab8e"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.256913 20794 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 10:03:17.257776 20809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.257964 20794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:03:17.258054 20794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "5805e1baf8de4a13a3a380e2b34fcbba"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "70a473f044088a9320a47515d78d6dd1"
server_key_iv: "87021db4450a45d4dca3dc982f6bab8e"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.258126 20794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:17.262508 20794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:17.262833 20794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:17.262987 20794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:17.263247 20794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:17.263584 20794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:17.263630 20794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.263654 20794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:17.263676 20794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.270174 20794 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:46163
I20260811 10:03:17.270226 20938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:46163 every 8 connection(s)
I20260811 10:03:17.270521 20794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:03:17.273514 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:17.271232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:44237 (local address 127.9.127.254:45529)
0811 10:03:17.271296 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:17.271298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:17.271549 (+ 251us) server_negotiation.cc:407] Connection header received
0811 10:03:17.271965 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:17.271966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:17.271970 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:17.272029 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:17.273295 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:17.273296 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:17.273296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:03:17.273299 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:17.273312 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:03:17.273316 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:17.273360 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:17.273451 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 10:03:17.273464 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 10:03:17.273589 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 20794
I20260811 10:03:17.273686 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:03:17.273749 20941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:17.271227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45529 (local address 127.9.127.193:44237)
0811 10:03:17.271414 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:17.271452 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:17.271888 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:17.272078 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:17.272081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:17.272090 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:17.273159 (+ 1069us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:03:17.273160 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:17.273189 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:03:17.273218 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:17.273359 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:17.273361 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:17.273363 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:03:17.273459 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 10:03:17.273524 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260811 10:03:17.274041 9727 external_mini_cluster.cc:1428] Setting key 5a8e59da6e22a0b90a8e5f3ffda747fb
I20260811 10:03:17.274554 20939 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45529
I20260811 10:03:17.274639 20939 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:17.274780 20939 heartbeater.cc:511] Master 127.9.127.254:45529 requested a full tablet report, sending...
I20260811 10:03:17.275027 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45529
--builtin_ntp_servers=127.9.127.212:46269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 10:03:17.275333 20725 ts_manager.cc:194] Registered new tserver with Master: 5805e1baf8de4a13a3a380e2b34fcbba (127.9.127.193:46163)
W20260811 10:03:17.354597 20942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:17.354773 20942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:17.354813 20942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:17.355958 20942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:17.356000 20942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:17.356026 20942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:03:17.357422 20942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:17.357672 20942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:17.357964 20942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:17.362653 20952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:17.362772 20950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:17.362790 20948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:17.362978 20942 server_base.cc:1034] running on GCE node
I20260811 10:03:17.363173 20942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:17.363430 20942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:17.364566 20942 hybrid_clock.cc:648] HybridClock initialized: now 1786442597364557 us; error 27 us; skew 500 ppm
I20260811 10:03:17.365775 20942 webserver.cc:460] Webserver started at http://127.9.127.194:42719/ using document root <none> and password file <none>
I20260811 10:03:17.366011 20942 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:17.366056 20942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:17.366204 20942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:17.367252 20942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "03d5bc38d00c4865badf7be896e94799"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "966daccfa50fac6cf16b07232c49a9d0"
server_key_iv: "e62e27543c221e347653a98ca3d41fea"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.367622 20942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "03d5bc38d00c4865badf7be896e94799"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "966daccfa50fac6cf16b07232c49a9d0"
server_key_iv: "e62e27543c221e347653a98ca3d41fea"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.369206 20942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:03:17.369899 20958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.370067 20942 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:03:17.370172 20942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "03d5bc38d00c4865badf7be896e94799"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "966daccfa50fac6cf16b07232c49a9d0"
server_key_iv: "e62e27543c221e347653a98ca3d41fea"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.370251 20942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:17.373571 20942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:17.373827 20942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:17.374019 20942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:17.374233 20942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:17.374532 20942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:17.374581 20942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.374611 20942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:17.374639 20942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.380851 20942 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:45041
I20260811 10:03:17.380895 21095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:45041 every 8 connection(s)
I20260811 10:03:17.381244 20942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:03:17.384195 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:17.381999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:53765 (local address 127.9.127.254:45529)
0811 10:03:17.382078 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:17.382080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:17.382291 (+ 211us) server_negotiation.cc:407] Connection header received
0811 10:03:17.382705 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:17.382706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:17.382730 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:17.382811 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:17.383986 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:17.383988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:17.383988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:03:17.383992 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:17.384008 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:03:17.384012 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:17.384066 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:17.384129 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 10:03:17.384141 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 10:03:17.384364 21098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:17.381959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45529 (local address 127.9.127.194:53765)
0811 10:03:17.382159 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:17.382188 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:17.382624 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:17.382858 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:17.382861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:17.382869 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:17.383806 (+ 937us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:03:17.383807 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:17.383833 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:03:17.383887 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:17.384064 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:17.384066 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:17.384069 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:03:17.384118 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 10:03:17.384164 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":104,"threads_started":1}
I20260811 10:03:17.384950 21096 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45529
I20260811 10:03:17.385051 21096 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:17.385201 21096 heartbeater.cc:511] Master 127.9.127.254:45529 requested a full tablet report, sending...
I20260811 10:03:17.385563 20725 ts_manager.cc:194] Registered new tserver with Master: 03d5bc38d00c4865badf7be896e94799 (127.9.127.194:45041)
I20260811 10:03:17.390234 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 20942
I20260811 10:03:17.390352 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:03:17.390534 9727 external_mini_cluster.cc:1428] Setting key bc4786e58f258646db412d09066383fa
I20260811 10:03:17.391464 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45529
--builtin_ntp_servers=127.9.127.212:46269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 10:03:17.473055 21100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:17.473306 21100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:17.473346 21100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:17.474677 21100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:17.474737 21100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:17.474781 21100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:03:17.476020 21100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:45529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:17.476272 21100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:17.476550 21100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:17.481209 21107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:17.481339 21100 server_base.cc:1034] running on GCE node
W20260811 10:03:17.481218 21106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:17.481292 21109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:17.481635 21100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:17.481930 21100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:17.483098 21100 hybrid_clock.cc:648] HybridClock initialized: now 1786442597483075 us; error 34 us; skew 500 ppm
I20260811 10:03:17.484491 21100 webserver.cc:460] Webserver started at http://127.9.127.195:37865/ using document root <none> and password file <none>
I20260811 10:03:17.484730 21100 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:17.484830 21100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:17.485023 21100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:17.485999 21100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "22c5a907f3394db1a82e6068f498ad8f"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "9a25268d474f2c0ee6cecd22142939e7"
server_key_iv: "2487c4cc2bd2f9e638c34b91f3437b69"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.486389 21100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "22c5a907f3394db1a82e6068f498ad8f"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "9a25268d474f2c0ee6cecd22142939e7"
server_key_iv: "2487c4cc2bd2f9e638c34b91f3437b69"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.487674 21100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:03:17.488346 21115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.488519 21100 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:03:17.488621 21100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "22c5a907f3394db1a82e6068f498ad8f"
format_stamp: "Formatted at 2026-08-11 10:03:17 on dist-test-slave-1x4g"
server_key: "9a25268d474f2c0ee6cecd22142939e7"
server_key_iv: "2487c4cc2bd2f9e638c34b91f3437b69"
server_key_version: "encryptionkey@0"
I20260811 10:03:17.488706 21100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:17.491946 21100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:17.492184 21100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:17.492319 21100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:17.492534 21100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:17.492903 21100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:17.492962 21100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.493002 21100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:17.493032 21100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:17.499233 21100 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:41643
I20260811 10:03:17.499264 21238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:41643 every 8 connection(s)
I20260811 10:03:17.499569 21100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:03:17.502295 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:17.500286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:47877 (local address 127.9.127.254:45529)
0811 10:03:17.500346 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:17.500349 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:17.500544 (+ 195us) server_negotiation.cc:407] Connection header received
0811 10:03:17.501018 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:17.501019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:17.501024 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:17.501076 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:17.502071 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:17.502072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:17.502072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:03:17.502076 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:17.502089 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:03:17.502092 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:17.502155 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:17.502233 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 10:03:17.502244 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:03:17.502512 21242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:17.500245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:45529 (local address 127.9.127.195:47877)
0811 10:03:17.500430 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:17.500464 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:17.500930 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:17.501121 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:17.501124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:17.501131 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:17.501907 (+ 776us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:03:17.501907 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:17.501948 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:03:17.501975 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:17.502175 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:17.502177 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:17.502179 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:03:17.502239 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 10:03:17.502283 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260811 10:03:17.502964 21239 heartbeater.cc:347] Connected to a master server at 127.9.127.254:45529
I20260811 10:03:17.503065 21239 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:17.503235 21239 heartbeater.cc:511] Master 127.9.127.254:45529 requested a full tablet report, sending...
I20260811 10:03:17.503582 20725 ts_manager.cc:194] Registered new tserver with Master: 22c5a907f3394db1a82e6068f498ad8f (127.9.127.195:41643)
I20260811 10:03:17.506660 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 21100
I20260811 10:03:17.506776 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:03:17.506971 9727 external_mini_cluster.cc:1428] Setting key b00f0ca76d650624cce4e7083e0313cd
I20260811 10:03:17.507902 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 10:03:17.509755 20772 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:17.509301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60858 (local address 127.9.127.254:45529)
0811 10:03:17.509360 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:17.509361 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:17.509430 (+ 69us) server_negotiation.cc:407] Connection header received
0811 10:03:17.509493 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:17.509494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:17.509497 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:17.509546 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:17.509674 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60858: BlockingRecv error: recv got EOF from 127.0.0.1:60858 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:03:17.509857 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 20794
I20260811 10:03:17.521337 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 20942
I20260811 10:03:17.527868 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 21100
I20260811 10:03:17.536679 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 20688
2026-08-11T10:03:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (540 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:03:17 dist-test-slave-1x4g krb5kdc[21251](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:03:17 dist-test-slave-1x4g krb5kdc[21251](info): set up 2 sockets
Aug 11 10:03:17 dist-test-slave-1x4g krb5kdc[21251](info): commencing operation
krb5kdc: starting...
W20260811 10:03:18.594875 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:03:18 dist-test-slave-1x4g krb5kdc[21251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:03:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:03:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:03:18.708140 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33869
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:44391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:33869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:18.786960 21264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:18.787177 21264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:18.787218 21264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:18.788338 21264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:03:18.788403 21264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:18.788427 21264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:18.788455 21264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:03:18.788482 21264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:03:18.789907 21264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:44391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:33869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:18.790166 21264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:18.790395 21264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:18.794939 21273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:18.795006 21271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:18.795027 21270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:18.795157 21264 server_base.cc:1034] running on GCE node
I20260811 10:03:18.795380 21264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:18.795671 21264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:18.796837 21264 hybrid_clock.cc:648] HybridClock initialized: now 1786442598796815 us; error 36 us; skew 500 ppm
Aug 11 10:03:18 dist-test-slave-1x4g krb5kdc[21251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:18.799175 21264 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:03:18.799603 21264 webserver.cc:460] Webserver started at http://127.9.127.254:43849/ using document root <none> and password file <none>
I20260811 10:03:18.799861 21264 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:18.799906 21264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:18.800042 21264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:18.801086 21264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "194a8ddfebd44ec39eaf47b3a1e89361"
format_stamp: "Formatted at 2026-08-11 10:03:18 on dist-test-slave-1x4g"
server_key: "8a01517945d52f35609368cb6a5e9782"
server_key_iv: "a634e17860543aafe28c71dc17392bab"
server_key_version: "encryptionkey@0"
I20260811 10:03:18.801430 21264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "194a8ddfebd44ec39eaf47b3a1e89361"
format_stamp: "Formatted at 2026-08-11 10:03:18 on dist-test-slave-1x4g"
server_key: "8a01517945d52f35609368cb6a5e9782"
server_key_iv: "a634e17860543aafe28c71dc17392bab"
server_key_version: "encryptionkey@0"
I20260811 10:03:18.802745 21264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:03:18.803457 21280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:18.803633 21264 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:03:18.803726 21264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "194a8ddfebd44ec39eaf47b3a1e89361"
format_stamp: "Formatted at 2026-08-11 10:03:18 on dist-test-slave-1x4g"
server_key: "8a01517945d52f35609368cb6a5e9782"
server_key_iv: "a634e17860543aafe28c71dc17392bab"
server_key_version: "encryptionkey@0"
I20260811 10:03:18.803798 21264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:18.812816 21264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:18.814495 21264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:18.814647 21264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:18.818756 21264 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:33869
I20260811 10:03:18.818785 21340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:33869 every 8 connection(s)
I20260811 10:03:18.819114 21264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:03:18.820047 21341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:03:18.822098 21341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361: Bootstrap starting.
I20260811 10:03:18.822450 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 21264
I20260811 10:03:18.822536 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:03:18.822642 21341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361: Neither blocks nor log segments found. Creating new log.
I20260811 10:03:18.822746 9727 external_mini_cluster.cc:1428] Setting key a02b7b536fff051f4ab942e14074bda8
I20260811 10:03:18.823005 21341 log.cc:824] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361: Log is configured to *not* fsync() on all Append() calls
I20260811 10:03:18.823720 21341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361: No bootstrap required, opened a new log
I20260811 10:03:18.825543 21341 raft_consensus.cc:348] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a8ddfebd44ec39eaf47b3a1e89361" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33869 } }
I20260811 10:03:18.825691 21341 raft_consensus.cc:374] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:03:18.825750 21341 raft_consensus.cc:729] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 194a8ddfebd44ec39eaf47b3a1e89361, State: Initialized, Role: FOLLOWER
I20260811 10:03:18.825893 21341 consensus_queue.cc:260] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a8ddfebd44ec39eaf47b3a1e89361" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33869 } }
I20260811 10:03:18.825965 21341 raft_consensus.cc:388] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:03:18.825987 21341 raft_consensus.cc:482] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:03:18.826032 21341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:03:18.826531 21341 raft_consensus.cc:504] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a8ddfebd44ec39eaf47b3a1e89361" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33869 } }
I20260811 10:03:18.826653 21341 leader_election.cc:302] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 194a8ddfebd44ec39eaf47b3a1e89361; no voters:
I20260811 10:03:18.826833 21341 leader_election.cc:288] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:03:18.826853 21346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:03:18.826996 21346 raft_consensus.cc:686] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [term 1 LEADER]: Becoming Leader. State: Replica: 194a8ddfebd44ec39eaf47b3a1e89361, State: Running, Role: LEADER
I20260811 10:03:18.827098 21346 consensus_queue.cc:237] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a8ddfebd44ec39eaf47b3a1e89361" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33869 } }
I20260811 10:03:18.827106 21341 sys_catalog.cc:564] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:03:18.827425 21346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "194a8ddfebd44ec39eaf47b3a1e89361" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a8ddfebd44ec39eaf47b3a1e89361" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33869 } } }
I20260811 10:03:18.827539 21346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:18.827673 21346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 194a8ddfebd44ec39eaf47b3a1e89361. Latest consensus state: current_term: 1 leader_uuid: "194a8ddfebd44ec39eaf47b3a1e89361" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194a8ddfebd44ec39eaf47b3a1e89361" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33869 } } }
I20260811 10:03:18.827772 21346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361 [sys.catalog]: This master's current role is: LEADER
I20260811 10:03:18.827925 21353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:03:18.828449 21353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 10:03:18 dist-test-slave-1x4g krb5kdc[21251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:03:18.834038 21345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:18.823275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38920 (local address 127.9.127.254:33869)
0811 10:03:18.823478 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:18.823487 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:18.823512 (+ 25us) server_negotiation.cc:407] Connection header received
0811 10:03:18.823944 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:18.823951 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:18.824003 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:18.824145 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:18.824808 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:18.825603 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:18.826444 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:18.826987 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:18.827089 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:18.830143 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:18.830147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:18.830147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:18.830159 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:18.832001 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:18.832551 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:18.832554 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:18.832554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:18.832649 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:18.832915 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:18.832916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:18.832917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:18.833240 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:18.833402 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:18.833663 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 10:03:18.833810 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260811 10:03:18.834400 21353 catalog_manager.cc:1347] Generated new cluster ID: 080ef5a1421a47028be0c2d7cd01c115
I20260811 10:03:18.834443 21353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:03:18.850950 21353 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:03:18.851393 21353 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:03:18.856710 21353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361: Generated new TSK 0
I20260811 10:03:18.856899 21353 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:03:18.887784 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33869
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:44391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:18.964206 21371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:18.964457 21371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:18.964490 21371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:18.965786 21371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:18.965847 21371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:18.965888 21371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:03:18.967209 21371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:44391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:18.967458 21371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:18.967654 21371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:18.972378 21378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:18.972389 21381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:18.972391 21377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:18.972705 21371 server_base.cc:1034] running on GCE node
I20260811 10:03:18.972929 21371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:18.973173 21371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:18.974311 21371 hybrid_clock.cc:648] HybridClock initialized: now 1786442598974301 us; error 29 us; skew 500 ppm
Aug 11 10:03:18 dist-test-slave-1x4g krb5kdc[21251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:18.976891 21371 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:03:18.977361 21371 webserver.cc:460] Webserver started at http://127.9.127.193:39631/ using document root <none> and password file <none>
I20260811 10:03:18.977556 21371 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:18.977596 21371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:18.977682 21371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:18.978617 21371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "9b647ea2a4aa47c594904dcea014285d"
format_stamp: "Formatted at 2026-08-11 10:03:18 on dist-test-slave-1x4g"
server_key: "d83eed7f60b034424236924883b11f5d"
server_key_iv: "023b674845473e3bcbae947a5bcf4101"
server_key_version: "encryptionkey@0"
I20260811 10:03:18.978899 21371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "9b647ea2a4aa47c594904dcea014285d"
format_stamp: "Formatted at 2026-08-11 10:03:18 on dist-test-slave-1x4g"
server_key: "d83eed7f60b034424236924883b11f5d"
server_key_iv: "023b674845473e3bcbae947a5bcf4101"
server_key_version: "encryptionkey@0"
I20260811 10:03:18.980069 21371 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:03:18.980654 21388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:18.980844 21371 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:03:18.980935 21371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "9b647ea2a4aa47c594904dcea014285d"
format_stamp: "Formatted at 2026-08-11 10:03:18 on dist-test-slave-1x4g"
server_key: "d83eed7f60b034424236924883b11f5d"
server_key_iv: "023b674845473e3bcbae947a5bcf4101"
server_key_version: "encryptionkey@0"
I20260811 10:03:18.981014 21371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:18.996892 21371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:18.999053 21371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:18.999213 21371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:18.999420 21371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:18.999730 21371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:18.999779 21371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:18.999817 21371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:18.999842 21371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:19.005431 21371 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:41583
I20260811 10:03:19.005486 21520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:41583 every 8 connection(s)
I20260811 10:03:19.005772 21371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
Aug 11 10:03:19 dist-test-slave-1x4g krb5kdc[21251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442598, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:03:19.012460 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 21371
I20260811 10:03:19.012605 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:03:19.012902 9727 external_mini_cluster.cc:1428] Setting key f214c7554a9a1e68681cb862a99b3577
I20260811 10:03:19.015031 21345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.006445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:53347 (local address 127.9.127.254:33869)
0811 10:03:19.006499 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.006501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.006705 (+ 204us) server_negotiation.cc:407] Connection header received
0811 10:03:19.007183 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.007185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.007196 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.007249 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:19.008283 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.008750 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.009733 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.009952 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.010037 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.011975 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:19.011983 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:19.011984 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:19.011991 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:19.013647 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:19.014050 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:19.014051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:19.014052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:19.014108 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:19.014367 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:19.014368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:19.014369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:19.014495 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:19.014568 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.014844 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.014935 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 10:03:19.015152 21524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.006456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33869 (local address 127.9.127.193:53347)
0811 10:03:19.006595 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.006632 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:19.007090 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:19.007311 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:19.007315 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:19.007987 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:19.008152 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.008156 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.008877 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.008878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.009629 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.009632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.010049 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.010050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.010171 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.010655 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:19.010663 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:19.011882 (+ 1219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:19.013734 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:19.013742 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:19.013744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:19.013959 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:19.014183 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:19.014184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:19.014184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:19.014293 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:19.014561 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:19.014568 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:19.014700 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 10:03:19.014798 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 10:03:19.014948 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
I20260811 10:03:19.015621 21521 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33869
I20260811 10:03:19.015729 21521 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:19.015913 21521 heartbeater.cc:511] Master 127.9.127.254:33869 requested a full tablet report, sending...
I20260811 10:03:19.016403 21300 ts_manager.cc:194] Registered new tserver with Master: 9b647ea2a4aa47c594904dcea014285d (127.9.127.193:41583)
I20260811 10:03:19.017102 21300 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:53347
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:03:19.039997 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33869
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:44391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:19.120525 21527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:19.120704 21527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:19.120728 21527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:19.121801 21527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:19.121836 21527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:19.121861 21527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:03:19.123220 21527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:44391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:19.123416 21527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:19.123576 21527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:19.128487 21536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:19.128487 21532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:19.128543 21527 server_base.cc:1034] running on GCE node
W20260811 10:03:19.128516 21533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:19.128870 21527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:19.129063 21527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:19.130198 21527 hybrid_clock.cc:648] HybridClock initialized: now 1786442599130188 us; error 28 us; skew 500 ppm
Aug 11 10:03:19 dist-test-slave-1x4g krb5kdc[21251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442599, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:19.132659 21527 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:03:19.133104 21527 webserver.cc:460] Webserver started at http://127.9.127.194:42349/ using document root <none> and password file <none>
I20260811 10:03:19.133371 21527 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:19.133440 21527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:19.133592 21527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:19.134673 21527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "cbfaa000be0442b881d0516debfac545"
format_stamp: "Formatted at 2026-08-11 10:03:19 on dist-test-slave-1x4g"
server_key: "c046a384bcee551d56a87a2f2785bcae"
server_key_iv: "62b05287e997e8c0395fa2d4a7dac09b"
server_key_version: "encryptionkey@0"
I20260811 10:03:19.135040 21527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "cbfaa000be0442b881d0516debfac545"
format_stamp: "Formatted at 2026-08-11 10:03:19 on dist-test-slave-1x4g"
server_key: "c046a384bcee551d56a87a2f2785bcae"
server_key_iv: "62b05287e997e8c0395fa2d4a7dac09b"
server_key_version: "encryptionkey@0"
I20260811 10:03:19.136377 21527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 10:03:19.137158 21543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:19.137323 21527 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:19.137425 21527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "cbfaa000be0442b881d0516debfac545"
format_stamp: "Formatted at 2026-08-11 10:03:19 on dist-test-slave-1x4g"
server_key: "c046a384bcee551d56a87a2f2785bcae"
server_key_iv: "62b05287e997e8c0395fa2d4a7dac09b"
server_key_version: "encryptionkey@0"
I20260811 10:03:19.137506 21527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:19.165488 21527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:19.167729 21527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:19.167883 21527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:19.168100 21527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:19.168390 21527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:19.168459 21527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:19.168490 21527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:19.168610 21527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:19.174799 21527 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:40773
I20260811 10:03:19.174845 21666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:40773 every 8 connection(s)
I20260811 10:03:19.175177 21527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:03:19 dist-test-slave-1x4g krb5kdc[21251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442599, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:03:19.184079 21345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.175836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:43537 (local address 127.9.127.254:33869)
0811 10:03:19.175896 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.175899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.176070 (+ 171us) server_negotiation.cc:407] Connection header received
0811 10:03:19.176604 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.176605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.176619 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.176687 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:19.177728 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.178241 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.179233 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.179442 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.179533 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.181538 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:19.181539 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:19.181540 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:19.181548 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:19.182677 (+ 1129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:19.183081 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:19.183083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:19.183083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:19.183139 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:19.183402 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:19.183403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:19.183423 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:19.183549 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:19.183623 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.183898 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.183985 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 10:03:19.184266 21669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.175790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33869 (local address 127.9.127.194:43537)
0811 10:03:19.175934 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.175986 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:19.176498 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:19.176755 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:19.176759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:19.177351 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:19.177639 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.177647 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.178341 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.178342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.179137 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.179139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.179546 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.179547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.179670 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.180082 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:19.180091 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:19.181439 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:19.182770 (+ 1331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:19.182777 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:19.182779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:19.182996 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:19.183201 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:19.183202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:19.183202 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:19.183329 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:19.183629 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:19.183636 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:19.183766 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 10:03:19.183876 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 10:03:19.184037 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260811 10:03:19.184849 21667 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33869
I20260811 10:03:19.184973 21667 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:19.185134 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 21527
I20260811 10:03:19.185163 21667 heartbeater.cc:511] Master 127.9.127.254:33869 requested a full tablet report, sending...
I20260811 10:03:19.185250 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:03:19.185463 9727 external_mini_cluster.cc:1428] Setting key ea6c89ae96c47f377c8250050daf9684
I20260811 10:03:19.185554 21300 ts_manager.cc:194] Registered new tserver with Master: cbfaa000be0442b881d0516debfac545 (127.9.127.194:40773)
I20260811 10:03:19.186072 21300 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:43537
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:03:19.209592 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33869
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:44391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:03:19.289459 21672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:03:19.289641 21672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:03:19.289664 21672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:03:19.290741 21672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:03:19.290781 21672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:03:19.290828 21672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:03:19.292243 21672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:44391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:03:19.292433 21672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:03:19.292665 21672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:03:19.297515 21678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:19.297492 21682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:03:19.297499 21679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:03:19.297747 21672 server_base.cc:1034] running on GCE node
I20260811 10:03:19.297971 21672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:03:19.298252 21672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:03:19.299420 21672 hybrid_clock.cc:648] HybridClock initialized: now 1786442599299402 us; error 49 us; skew 500 ppm
Aug 11 10:03:19 dist-test-slave-1x4g krb5kdc[21251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442599, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:03:19.301822 21672 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:03:19.302281 21672 webserver.cc:460] Webserver started at http://127.9.127.195:34223/ using document root <none> and password file <none>
I20260811 10:03:19.302492 21672 fs_manager.cc:359] Metadata directory not provided
I20260811 10:03:19.302559 21672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:03:19.302708 21672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:03:19.303766 21672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "0966cd0c5bd14d588e49bf63d6438ddd"
format_stamp: "Formatted at 2026-08-11 10:03:19 on dist-test-slave-1x4g"
server_key: "b7158dd671321005fffb873c2c9a7abe"
server_key_iv: "3a315f07592ba9143cebafa9305fbf36"
server_key_version: "encryptionkey@0"
I20260811 10:03:19.304127 21672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "0966cd0c5bd14d588e49bf63d6438ddd"
format_stamp: "Formatted at 2026-08-11 10:03:19 on dist-test-slave-1x4g"
server_key: "b7158dd671321005fffb873c2c9a7abe"
server_key_iv: "3a315f07592ba9143cebafa9305fbf36"
server_key_version: "encryptionkey@0"
I20260811 10:03:19.305505 21672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:03:19.306201 21690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:19.306370 21672 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:03:19.306468 21672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "0966cd0c5bd14d588e49bf63d6438ddd"
format_stamp: "Formatted at 2026-08-11 10:03:19 on dist-test-slave-1x4g"
server_key: "b7158dd671321005fffb873c2c9a7abe"
server_key_iv: "3a315f07592ba9143cebafa9305fbf36"
server_key_version: "encryptionkey@0"
I20260811 10:03:19.306542 21672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:03:19.314482 21672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:03:19.316148 21672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:03:19.316298 21672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:03:19.316497 21672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:03:19.316879 21672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:03:19.316936 21672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:19.316974 21672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:03:19.317003 21672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:03:19.322582 21672 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:42477
I20260811 10:03:19.322635 21813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:42477 every 8 connection(s)
I20260811 10:03:19.322942 21672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:03:19.323851 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 21672
I20260811 10:03:19.323976 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:03:19.324205 9727 external_mini_cluster.cc:1428] Setting key 9d3fa7fc5b183a2fd5d1ad1606b05094
Aug 11 10:03:19 dist-test-slave-1x4g krb5kdc[21251](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442599, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:03:19.332005 21345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.323715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:33299 (local address 127.9.127.254:33869)
0811 10:03:19.323783 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.323785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.323992 (+ 207us) server_negotiation.cc:407] Connection header received
0811 10:03:19.324666 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.324667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.324679 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.324725 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:19.325789 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.326259 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.327230 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.327433 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.327500 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.329525 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:19.329526 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:19.329526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:19.329533 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:19.330867 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:19.331219 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:19.331219 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:19.331220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:19.331270 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:19.331491 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:19.331491 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:19.331491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:19.331602 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:19.331650 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.331883 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.331941 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 10:03:19.332120 21816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.323658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33869 (local address 127.9.127.195:33299)
0811 10:03:19.323848 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.323897 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:19.324547 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:19.324826 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:19.324830 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:19.325528 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:03:19.325710 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.325715 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.326338 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.326338 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.327163 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.327166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.327525 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.327526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.327633 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.328037 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:03:19.328045 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:03:19.329431 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:03:19.330932 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:19.330938 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:19.330940 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:19.331136 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:19.331327 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:03:19.331327 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:03:19.331328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:03:19.331430 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:03:19.331656 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:03:19.331661 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:03:19.331765 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 10:03:19.331842 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 10:03:19.331950 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":87,"threads_started":1}
I20260811 10:03:19.332612 21814 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33869
I20260811 10:03:19.332719 21814 heartbeater.cc:464] Registering TS with master...
I20260811 10:03:19.332912 21814 heartbeater.cc:511] Master 127.9.127.254:33869 requested a full tablet report, sending...
I20260811 10:03:19.333312 21298 ts_manager.cc:194] Registered new tserver with Master: 0966cd0c5bd14d588e49bf63d6438ddd (127.9.127.195:42477)
I20260811 10:03:19.333705 21298 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:33299
I20260811 10:03:19.336043 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:03:19.342612 21345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.337427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.9.127.254:33869)
0811 10:03:19.337466 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.337468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.337604 (+ 136us) server_negotiation.cc:407] Connection header received
0811 10:03:19.337640 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.337640 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.337648 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.337692 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:03:19.338188 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.338611 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.339213 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.339367 (+ 154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.339410 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.340389 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:03:19.340390 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:03:19.340390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:03:19.340395 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:03:19.341751 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:19.342017 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:19.342018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:19.342018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:19.342062 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:03:19.342203 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:03:19.342203 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:03:19.342203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:03:19.342312 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:03:19.342376 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.342453 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.342513 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:03:19.344012 21298 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:03:19.345585 21298 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:03:19.351708 21827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.347648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:41583 (local address 127.0.0.1:55716)
0811 10:03:19.347842 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.347850 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:19.347889 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:19.348248 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:19.348252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:19.348254 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:03:19.348322 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.348325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.349674 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.349675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.350697 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.350700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.351425 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.351426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.351507 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.351520 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 10:03:19.351584 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 10:03:19.351638 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":59,"threads_started":1}
I20260811 10:03:19.351794 21830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.347984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46566 (local address 127.9.127.195:42477)
0811 10:03:19.348122 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.348126 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.348134 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:03:19.348167 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.348169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.348201 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.348431 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:03:19.348500 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.349314 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.350798 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.351444 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.351539 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.351587 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.351685 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.351721 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
I20260811 10:03:19.352052 21829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.347876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55716 (local address 127.9.127.193:41583)
0811 10:03:19.348046 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.348051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.348060 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:03:19.348101 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.348103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.348118 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.348220 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:03:19.348414 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.349548 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.350781 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.351338 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.351423 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.351481 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.351916 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.351956 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260811 10:03:19.352080 21825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.347633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:42477 (local address 127.0.0.1:46566)
0811 10:03:19.347778 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.347812 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:19.347876 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:19.348300 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:19.348301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:19.348304 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:03:19.348358 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.348360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.349419 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.349420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.350717 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.350719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.351546 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.351547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.351610 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.351612 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:03:19.351661 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 10:03:19.351692 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":49,"threads_started":1}
I20260811 10:03:19.352836 21826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.347632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:40773 (local address 127.0.0.1:59892)
0811 10:03:19.347789 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.347812 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:19.347977 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:19.348325 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:19.348326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:19.348327 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:03:19.348362 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.348363 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.350795 (+ 2432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.350795 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.351771 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.351773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.352596 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.352597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.352661 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.352664 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:03:19.352721 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 10:03:19.352758 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":2,"thread_start_us":53,"threads_started":1}
I20260811 10:03:19.352685 21443 tablet_service.cc:1467] Processing CreateTablet for tablet cef4f12f44264d798715e5927f6507fe (DEFAULT_TABLE table=test-table [id=95309f18cfec4f37b79d6e86d6ade50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:03:19.352905 21828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.347819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59892 (local address 127.9.127.194:40773)
0811 10:03:19.348090 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.348095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.348105 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:03:19.348142 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.348144 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.348164 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.348378 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:03:19.348453 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.349560 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.351865 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.352505 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.352591 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.352644 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.352735 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.352815 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":75,"threads_started":1}
I20260811 10:03:19.353091 21443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef4f12f44264d798715e5927f6507fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:03:19.353283 21743 tablet_service.cc:1467] Processing CreateTablet for tablet cef4f12f44264d798715e5927f6507fe (DEFAULT_TABLE table=test-table [id=95309f18cfec4f37b79d6e86d6ade50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:03:19.353518 21595 tablet_service.cc:1467] Processing CreateTablet for tablet cef4f12f44264d798715e5927f6507fe (DEFAULT_TABLE table=test-table [id=95309f18cfec4f37b79d6e86d6ade50a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:03:19.353622 21743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef4f12f44264d798715e5927f6507fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:03:19.353845 21595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cef4f12f44264d798715e5927f6507fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:03:19.356226 21831 tablet_bootstrap.cc:492] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: Bootstrap starting.
I20260811 10:03:19.356602 21832 tablet_bootstrap.cc:492] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d: Bootstrap starting.
I20260811 10:03:19.357131 21831 tablet_bootstrap.cc:654] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: Neither blocks nor log segments found. Creating new log.
I20260811 10:03:19.357468 21832 tablet_bootstrap.cc:654] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d: Neither blocks nor log segments found. Creating new log.
I20260811 10:03:19.357779 21831 log.cc:824] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: Log is configured to *not* fsync() on all Append() calls
I20260811 10:03:19.358131 21832 log.cc:824] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d: Log is configured to *not* fsync() on all Append() calls
I20260811 10:03:19.358168 21834 tablet_bootstrap.cc:492] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: Bootstrap starting.
I20260811 10:03:19.358598 21831 tablet_bootstrap.cc:492] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: No bootstrap required, opened a new log
I20260811 10:03:19.358683 21831 ts_tablet_manager.cc:1397] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:03:19.358817 21834 tablet_bootstrap.cc:654] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: Neither blocks nor log segments found. Creating new log.
I20260811 10:03:19.358879 21832 tablet_bootstrap.cc:492] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d: No bootstrap required, opened a new log
I20260811 10:03:19.358960 21832 ts_tablet_manager.cc:1397] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:03:19.359376 21834 log.cc:824] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: Log is configured to *not* fsync() on all Append() calls
I20260811 10:03:19.360430 21834 tablet_bootstrap.cc:492] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: No bootstrap required, opened a new log
I20260811 10:03:19.360498 21834 ts_tablet_manager.cc:1397] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:03:19.360535 21831 raft_consensus.cc:348] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.360723 21831 raft_consensus.cc:374] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:03:19.360781 21831 raft_consensus.cc:729] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbfaa000be0442b881d0516debfac545, State: Initialized, Role: FOLLOWER
I20260811 10:03:19.360685 21832 raft_consensus.cc:348] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.360889 21832 raft_consensus.cc:374] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:03:19.360924 21832 raft_consensus.cc:729] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b647ea2a4aa47c594904dcea014285d, State: Initialized, Role: FOLLOWER
I20260811 10:03:19.360913 21831 consensus_queue.cc:260] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.361024 21832 consensus_queue.cc:260] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.361195 21831 ts_tablet_manager.cc:1428] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:03:19.361300 21832 ts_tablet_manager.cc:1428] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:03:19.361294 21667 heartbeater.cc:503] Master 127.9.127.254:33869 was elected leader, sending a full tablet report...
I20260811 10:03:19.361447 21521 heartbeater.cc:503] Master 127.9.127.254:33869 was elected leader, sending a full tablet report...
I20260811 10:03:19.362747 21834 raft_consensus.cc:348] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.362854 21834 raft_consensus.cc:374] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:03:19.362874 21834 raft_consensus.cc:729] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0966cd0c5bd14d588e49bf63d6438ddd, State: Initialized, Role: FOLLOWER
I20260811 10:03:19.363000 21834 consensus_queue.cc:260] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.363294 21834 ts_tablet_manager.cc:1428] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:03:19.363305 21814 heartbeater.cc:503] Master 127.9.127.254:33869 was elected leader, sending a full tablet report...
I20260811 10:03:19.375269 21840 raft_consensus.cc:482] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:03:19.375370 21840 raft_consensus.cc:504] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.375736 21840 leader_election.cc:288] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0966cd0c5bd14d588e49bf63d6438ddd (127.9.127.195:42477), 9b647ea2a4aa47c594904dcea014285d (127.9.127.193:41583)
I20260811 10:03:19.379504 21830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.375971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:42725 (local address 127.9.127.195:42477)
0811 10:03:19.376023 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.376025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.376238 (+ 213us) server_negotiation.cc:407] Connection header received
0811 10:03:19.376299 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.376300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.376307 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.376368 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:03:19.376497 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.377213 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.378614 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.379154 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.379233 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.379243 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.379409 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.379446 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:03:19.379532 21843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.375906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:42477 (local address 127.9.127.194:42725)
0811 10:03:19.376168 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.376193 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:19.376244 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:19.376380 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:19.376381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:19.376382 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:03:19.376438 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.376439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.377287 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.377288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.378526 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.378529 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.379248 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.379249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.379323 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.379328 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:03:19.379402 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 10:03:19.379443 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":114,"thread_start_us":120,"threads_started":1}
I20260811 10:03:19.379704 21829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.375953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:51563 (local address 127.9.127.193:41583)
0811 10:03:19.376015 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.376017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.376032 (+ 15us) server_negotiation.cc:407] Connection header received
0811 10:03:19.376125 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.376126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.376136 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.376189 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:03:19.376361 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.377172 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.378614 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.379193 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.379252 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.379259 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.379581 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.379628 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:03:19.379858 21669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.375906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:41583 (local address 127.9.127.194:51563)
0811 10:03:19.375965 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.375993 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 10:03:19.376046 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:03:19.376213 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:03:19.376214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:03:19.376215 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:03:19.376291 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.376293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.377241 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.377242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.378527 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:03:19.378529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.379301 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.379320 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:03:19.379406 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.379411 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:03:19.379459 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 10:03:19.379506 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":56}
I20260811 10:03:19.379844 21765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef4f12f44264d798715e5927f6507fe" candidate_uuid: "cbfaa000be0442b881d0516debfac545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" is_pre_election: true
I20260811 10:03:19.379992 21765 raft_consensus.cc:2454] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfaa000be0442b881d0516debfac545 in term 0.
I20260811 10:03:19.380201 21544 leader_election.cc:302] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0966cd0c5bd14d588e49bf63d6438ddd, cbfaa000be0442b881d0516debfac545; no voters:
I20260811 10:03:19.380192 21470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef4f12f44264d798715e5927f6507fe" candidate_uuid: "cbfaa000be0442b881d0516debfac545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b647ea2a4aa47c594904dcea014285d" is_pre_election: true
I20260811 10:03:19.380333 21470 raft_consensus.cc:2454] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbfaa000be0442b881d0516debfac545 in term 0.
I20260811 10:03:19.380343 21840 raft_consensus.cc:2781] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:03:19.380395 21840 raft_consensus.cc:482] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:03:19.380434 21840 raft_consensus.cc:3037] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:03:19.381270 21840 raft_consensus.cc:504] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.381405 21840 leader_election.cc:288] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [CANDIDATE]: Term 1 election: Requested vote from peers 0966cd0c5bd14d588e49bf63d6438ddd (127.9.127.195:42477), 9b647ea2a4aa47c594904dcea014285d (127.9.127.193:41583)
I20260811 10:03:19.381585 21765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef4f12f44264d798715e5927f6507fe" candidate_uuid: "cbfaa000be0442b881d0516debfac545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0966cd0c5bd14d588e49bf63d6438ddd"
I20260811 10:03:19.381657 21470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cef4f12f44264d798715e5927f6507fe" candidate_uuid: "cbfaa000be0442b881d0516debfac545" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b647ea2a4aa47c594904dcea014285d"
I20260811 10:03:19.381690 21765 raft_consensus.cc:3037] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:03:19.381743 21470 raft_consensus.cc:3037] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:03:19.382400 21765 raft_consensus.cc:2454] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfaa000be0442b881d0516debfac545 in term 1.
I20260811 10:03:19.382467 21470 raft_consensus.cc:2454] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbfaa000be0442b881d0516debfac545 in term 1.
I20260811 10:03:19.382670 21547 leader_election.cc:302] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b647ea2a4aa47c594904dcea014285d, cbfaa000be0442b881d0516debfac545; no voters:
I20260811 10:03:19.382805 21840 raft_consensus.cc:2781] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:03:19.382963 21840 raft_consensus.cc:686] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 1 LEADER]: Becoming Leader. State: Replica: cbfaa000be0442b881d0516debfac545, State: Running, Role: LEADER
I20260811 10:03:19.383072 21840 consensus_queue.cc:237] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } }
I20260811 10:03:19.383847 21300 catalog_manager.cc:5495] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbfaa000be0442b881d0516debfac545 (127.9.127.194). New cstate: current_term: 1 leader_uuid: "cbfaa000be0442b881d0516debfac545" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbfaa000be0442b881d0516debfac545" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 } health_report { overall_health: UNKNOWN } } }
I20260811 10:03:19.390753 21828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:03:19.388823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59900 (local address 127.9.127.194:40773)
0811 10:03:19.388870 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:03:19.388871 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:03:19.388879 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:03:19.388904 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:03:19.388904 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:03:19.388918 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:03:19.388971 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:03:19.389095 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.389506 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.390162 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:03:19.390327 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:03:19.390372 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:03:19.390513 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:03:19.390592 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:03:19.390648 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 10:03:19.390679 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 10:03:19.390694 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:03:19.392328 21765 raft_consensus.cc:1261] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 1 FOLLOWER]: Refusing update from remote peer cbfaa000be0442b881d0516debfac545: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:03:19.392361 21470 raft_consensus.cc:1261] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [term 1 FOLLOWER]: Refusing update from remote peer cbfaa000be0442b881d0516debfac545: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:03:19.392693 21844 consensus_queue.cc:1035] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b647ea2a4aa47c594904dcea014285d" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:03:19.392827 21840 consensus_queue.cc:1035] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0966cd0c5bd14d588e49bf63d6438ddd" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 42477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:03:19.395052 21848 mvcc.cc:205] Tried to move back new op lower bound from 7317268887108595712 to 7317268887073644544. Current Snapshot: MvccSnapshot[applied={T|T < 7317268887108595712}]
I20260811 10:03:19.395148 21850 mvcc.cc:205] Tried to move back new op lower bound from 7317268887108595712 to 7317268887073644544. Current Snapshot: MvccSnapshot[applied={T|T < 7317268887108595712}]
I20260811 10:03:19.395571 21849 mvcc.cc:205] Tried to move back new op lower bound from 7317268887108595712 to 7317268887073644544. Current Snapshot: MvccSnapshot[applied={T|T < 7317268887108595712}]
I20260811 10:03:19.397094 21300 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:03:19.397190 21300 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:03:19.397943 21300 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 194a8ddfebd44ec39eaf47b3a1e89361: Sending DeleteTablet for 3 replicas of tablet cef4f12f44264d798715e5927f6507fe
I20260811 10:03:19.398232 21595 tablet_service.cc:1514] Processing DeleteTablet for tablet cef4f12f44264d798715e5927f6507fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:03:19 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:59892
I20260811 10:03:19.398299 21743 tablet_service.cc:1514] Processing DeleteTablet for tablet cef4f12f44264d798715e5927f6507fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:03:19 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:46566
I20260811 10:03:19.398376 21443 tablet_service.cc:1514] Processing DeleteTablet for tablet cef4f12f44264d798715e5927f6507fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:03:19 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:55716
I20260811 10:03:19.398553 21859 tablet_replica.cc:330] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d: stopping tablet replica
I20260811 10:03:19.398648 21859 raft_consensus.cc:2229] T cef4f12f44264d798715e5927f6507fe P 9b647ea2a4aa47c594904dcea014285d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:03:19.398695 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 21371
I20260811 10:03:19.399437 21858 tablet_replica.cc:330] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: stopping tablet replica
I20260811 10:03:19.399530 21858 raft_consensus.cc:2229] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:03:19.399618 21858 raft_consensus.cc:2258] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:03:19.400336 21858 ts_tablet_manager.cc:1905] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:03:19.402041 21858 ts_tablet_manager.cc:1918] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:03:19.402127 21858 log.cc:1196] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/cef4f12f44264d798715e5927f6507fe
I20260811 10:03:19.402407 21858 ts_tablet_manager.cc:1939] T cef4f12f44264d798715e5927f6507fe P 0966cd0c5bd14d588e49bf63d6438ddd: Deleting consensus metadata
I20260811 10:03:19.402872 21857 tablet_replica.cc:330] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: stopping tablet replica
I20260811 10:03:19.403092 21281 catalog_manager.cc:4841] TS 0966cd0c5bd14d588e49bf63d6438ddd (127.9.127.195:42477): tablet cef4f12f44264d798715e5927f6507fe (table test-table [id=95309f18cfec4f37b79d6e86d6ade50a]) successfully deleted
I20260811 10:03:19.403117 21857 raft_consensus.cc:2229] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:03:19.403298 21857 raft_consensus.cc:2258] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:03:19.403692 21857 ts_tablet_manager.cc:1905] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:03:19.405050 21857 ts_tablet_manager.cc:1918] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:03:19.405135 21857 log.cc:1196] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/cef4f12f44264d798715e5927f6507fe
I20260811 10:03:19.405385 21857 ts_tablet_manager.cc:1939] T cef4f12f44264d798715e5927f6507fe P cbfaa000be0442b881d0516debfac545: Deleting consensus metadata
W20260811 10:03:19.408298 21284 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:41583 (error 108)
I20260811 10:03:19.408641 21283 catalog_manager.cc:4841] TS cbfaa000be0442b881d0516debfac545 (127.9.127.194:40773): tablet cef4f12f44264d798715e5927f6507fe (table test-table [id=95309f18cfec4f37b79d6e86d6ade50a]) successfully deleted
W20260811 10:03:19.408833 21825 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:03:19.408678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:41583 (local address 127.0.0.1:43458)
0811 10:03:19.408739 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 10:03:19.408795 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:41583: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 10:03:19.408949 21284 catalog_manager.cc:4584] TS 9b647ea2a4aa47c594904dcea014285d (127.9.127.193:41583): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cef4f12f44264d798715e5927f6507fe: Network error: Client connection negotiation failed: client connection to 127.9.127.193:41583: connect: Connection reset by peer (error 104)
I20260811 10:03:19.409101 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 21527
I20260811 10:03:19.416363 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 21672
I20260811 10:03:19.421319 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 21264
2026-08-11T10:03:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1882 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:03:19 dist-test-slave-1x4g krb5kdc[21863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:03:19 dist-test-slave-1x4g krb5kdc[21863](info): set up 2 sockets
Aug 11 10:03:19 dist-test-slave-1x4g krb5kdc[21863](info): commencing operation
krb5kdc: starting...
W20260811 10:03:20.468106 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.026s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:03:20 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:03:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:03:20Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.127.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.127.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/rangeradmin_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/rangeradmin_127.9.127.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.127.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.127.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/rangerlookup_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/rangerlookup_127.9.127.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.127.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.127.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/HTTP_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/HTTP_127.9.127.212@KRBTEST.COM.keytab.
I20260811 10:03:20.623710 9727 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskwRyaEw/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/postgres -l logfile start
2026-08-11 10:03:23.000 UTC [21895] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 10:03:23.000 UTC [21895] LOG: listening on IPv4 address "127.9.127.212", port 54237
2026-08-11 10:03:23.003 UTC [21895] LOG: listening on Unix socket "/tmp/.s.PGSQL.54237"
2026-08-11 10:03:23.025 UTC [21898] LOG: database system was shut down at 2026-08-11 10:03:21 UTC
2026-08-11 10:03:23.028 UTC [21895] LOG: database system is ready to accept connections
I20260811 10:03:24.020884 9727 mini_postgres.cc:96] Postgres bound to 54237
2026-08-11 10:03:24.029 UTC [21907] FATAL: database "slave" does not exist
127.9.127.212:54237 - accepting connections
I20260811 10:03:24.030207 9727 mini_ranger.cc:161] Starting Ranger...
I20260811 10:03:24.045480 9727 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 10:03:24.492466 9727 mini_ranger.cc:87] Created ranger Postgres database
I20260811 10:03:24.492552 9727 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-admin
2026-08-11 10:03:24,806 [I] DB FLAVOR :POSTGRES
2026-08-11 10:03:24,807 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 10:03:24,807 [I] Checking connection..
2026-08-11 10:03:24,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 10:03:25,057 [I] Checking connection passed.
2026-08-11 10:03:25,057 [I] --------- Verifying version history table ---------
2026-08-11 10:03:25,057 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 10:03:25,285 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 10:03:25,285 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 10:03:25,527 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 10:03:25,528 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 10:03:25,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 10:03:25.747 UTC [21977] WARNING: there is no transaction in progress
2026-08-11 10:03:25,754 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 10:03:25,754 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 10:03:26,013 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 10:03:26,013 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 10:03:26,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 10:03:26,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 10:03:26,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1x4g.c.gcp-upstream.internal','N') ;"
2026-08-11 10:03:26,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 10:03:27,015 [I] Table x_portal_user does not exist in database ranger
2026-08-11 10:03:27,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 10:03:27,261 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 10:03:27,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 10:03:27,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 10:03:27,723 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 10:03:27,723 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 10:03:28.630 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.644 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.660 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.674 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.688 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.705 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.755 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.762 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.776 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.785 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.795 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.807 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.817 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.823 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.829 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:28.838 UTC [22093] WARNING: there is no transaction in progress
2026-08-11 10:03:29,445 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 10:03:29,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 10:03:29,680 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 10:03:29,680 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 10:03:29,930 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 10:03:29,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 10:03:30,185 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 10:03:30,186 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 10:03:30,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 10:03:30,680 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1x4g.c.gcp-upstream.internal';"
2026-08-11 10:03:30,911 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 10:03:30,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 10:03:31,135 [I] DB_PATCHES have already been applied
I20260811 10:03:31.141623 9727 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-admin:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskwRyaEw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 10:03:31.141729 9727 mini_ranger.cc:193] Using host: 127.9.127.212
I20260811 10:03:31.145917 9727 mini_ranger.cc:227] Ranger admin URL: http://127.9.127.212:42595
Aug 11, 2026 10:03:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 10:03:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 10:03:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 10:03:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 10:03:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 10:03:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 10:03:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 10:03:32.305732 9727 mini_ranger.cc:160] Time spent starting Ranger: real 8.276s user 0.007s sys 0.004s
Aug 11, 2026 10:03:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 10:03:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 10:03:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 10:03:53 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 10:03:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 10:03:54.518050 9727 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.127.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.127.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/rangerkms_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/rangerkms_127.9.127.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.127.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.127.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.127.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/HTTP_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.127.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/HTTP_127.9.127.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 10:03:54 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442634, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 10:03:54.603446 9727 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 10:03:54.613524 9727 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 10:03:55.379168 9727 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 10:03:55.379254 9727 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms
I20260811 10:03:55.379266 9727 mini_ranger_kms.cc:227] Using postgres at 127.9.127.212:54237
2026-08-11 10:03:55,854 [I] DB FLAVOR :POSTGRES
2026-08-11 10:03:55,854 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 10:03:55,854 [I] Checking connection
2026-08-11 10:03:55,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 10:03:56,127 [I] connection success
2026-08-11 10:03:56,127 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 10:03:56,127 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 10:03:56,127 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 10:03:56,364 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 10:03:56,364 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 10:03:56,364 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 10:03:56,364 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:54237/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 10:03:56,604 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 10:03:57.051306 9727 mini_ranger_kms.cc:310] Created kms service
I20260811 10:03:57.211756 9727 mini_ranger_kms.cc:326] Created kudu user
I20260811 10:03:57.253333 9727 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 10:03:57 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442634, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:03:57.662070 9727 mini_ranger_kms.cc:384] Added ranger policy
I20260811 10:03:57.662217 9727 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms:/tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 10:03:57.662245 9727 mini_ranger_kms.cc:240] Using host: 127.9.127.212
I20260811 10:03:57.666973 9727 mini_ranger_kms.cc:276] Ranger KMS PID: 22291
I20260811 10:03:57.667078 9727 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.127.212:47573
Aug 11, 2026 10:03:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 10:03:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 10:03:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 10:03:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 10:03:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 10:03:59 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 10:04:00.032537 9727 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.429s user 0.000s sys 0.450s
I20260811 10:04:00.032662 9727 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 10:04:00.032740 9727 mini_ranger_kms.cc:401] 127.9.127.212:47573/kms/v1/keys
Aug 11 10:04:00 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786442640, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.127.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 10:04:00 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442640, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.127.212@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
Aug 11 10:04:01 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442640, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.127.212@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
Aug 11 10:04:03 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:04:03.588567 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:42011
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:37555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:42011
--ranger_config_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:47573/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:03.689386 22347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:03.689587 22347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:03.689610 22347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:03.690768 22347 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:04:03.690810 22347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:03.690824 22347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:03.690837 22347 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:04:03.690850 22347 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:04:03.692530 22347 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.127.212:47573/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:42011
--ranger_config_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:42011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:03.692776 22347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:03.693048 22347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:03.699294 22353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:03.699308 22352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:03.699412 22347 server_base.cc:1034] running on GCE node
W20260811 10:04:03.699540 22356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:03.699805 22347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:03.700155 22347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:03.701318 22347 hybrid_clock.cc:648] HybridClock initialized: now 1786442643701293 us; error 40 us; skew 500 ppm
Aug 11 10:04:03 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442643, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:03.704125 22347 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:04:03.704594 22347 webserver.cc:460] Webserver started at http://127.9.127.254:39401/ using document root <none> and password file <none>
I20260811 10:04:03.704928 22347 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:03.704977 22347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:03.705114 22347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 10:04:03 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442643, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:03.763496 22347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "0619c3af6f084bd29cb668a65a1bb49a"
format_stamp: "Formatted at 2026-08-11 10:04:03 on dist-test-slave-1x4g"
server_key: "a2127e9e3d41db15f6cb6cfdfefc8425"
server_key_iv: "41c2a6adebf854aee66a9428f93b2d47"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:03.763972 22347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "0619c3af6f084bd29cb668a65a1bb49a"
format_stamp: "Formatted at 2026-08-11 10:04:03 on dist-test-slave-1x4g"
server_key: "a2127e9e3d41db15f6cb6cfdfefc8425"
server_key_iv: "41c2a6adebf854aee66a9428f93b2d47"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:03.765821 22347 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 10:04:03.778687 22363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:03.778980 22347 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:04:03.779091 22347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "0619c3af6f084bd29cb668a65a1bb49a"
format_stamp: "Formatted at 2026-08-11 10:04:03 on dist-test-slave-1x4g"
server_key: "a2127e9e3d41db15f6cb6cfdfefc8425"
server_key_iv: "41c2a6adebf854aee66a9428f93b2d47"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:03.779294 22347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:03.805131 22347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:03.807252 22347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:03.807438 22347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:03.816227 22347 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:42011
I20260811 10:04:03.816255 22418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:42011 every 8 connection(s)
I20260811 10:04:03.816682 22347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:04:03.817453 22419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:03.820303 22419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a: Bootstrap starting.
I20260811 10:04:03.821180 22419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:03.821760 22419 log.cc:824] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:03.822532 22419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a: No bootstrap required, opened a new log
I20260811 10:04:03.825520 22419 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0619c3af6f084bd29cb668a65a1bb49a" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42011 } }
I20260811 10:04:03.825727 22419 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:03.825771 22419 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0619c3af6f084bd29cb668a65a1bb49a, State: Initialized, Role: FOLLOWER
I20260811 10:04:03.825846 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 22347
I20260811 10:04:03.825960 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:04:03.826016 22419 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0619c3af6f084bd29cb668a65a1bb49a" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42011 } }
I20260811 10:04:03.826113 22419 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:04:03.826176 22419 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:04:03.826191 9727 external_mini_cluster.cc:1428] Setting key 883854b4176bf13fdce146d7d4d6ae0f
I20260811 10:04:03.826233 22419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:03.827158 22419 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0619c3af6f084bd29cb668a65a1bb49a" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42011 } }
I20260811 10:04:03.827283 22419 leader_election.cc:302] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0619c3af6f084bd29cb668a65a1bb49a; no voters:
I20260811 10:04:03.827509 22419 leader_election.cc:288] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:04:03.827741 22426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:04:03.827883 22419 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:04:03.828029 22426 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [term 1 LEADER]: Becoming Leader. State: Replica: 0619c3af6f084bd29cb668a65a1bb49a, State: Running, Role: LEADER
I20260811 10:04:03.828194 22426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0619c3af6f084bd29cb668a65a1bb49a" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42011 } }
I20260811 10:04:03.830338 22430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0619c3af6f084bd29cb668a65a1bb49a. Latest consensus state: current_term: 1 leader_uuid: "0619c3af6f084bd29cb668a65a1bb49a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0619c3af6f084bd29cb668a65a1bb49a" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42011 } } }
I20260811 10:04:03.830435 22430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:03.830753 22419 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 10:04:03.830989 22429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0619c3af6f084bd29cb668a65a1bb49a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0619c3af6f084bd29cb668a65a1bb49a" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42011 } } }
I20260811 10:04:03.831231 22429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:03.831923 22443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:04:03.832621 22443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 10:04:03 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:03.844322 22443 catalog_manager.cc:1347] Generated new cluster ID: 09436f0af8fc42f5bd52c09ea6af68b4
I20260811 10:04:03.844400 22443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:04:03.844704 22425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:03.826782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52988 (local address 127.9.127.254:42011)
0811 10:04:03.827059 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:03.827070 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:03.827166 (+ 96us) server_negotiation.cc:407] Connection header received
0811 10:04:03.827291 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:03.827299 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:03.827355 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:03.827497 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:03.828444 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:03.830591 (+ 2147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:03.832112 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:03.832708 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:03.832853 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:03.837761 (+ 4908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:03.837815 (+ 54us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:03.837816 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:03.837996 (+ 180us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:03.842557 (+ 4561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:03.843014 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:03.843021 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:03.843022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:03.843159 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:03.843427 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:03.843427 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:03.843428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:03.843849 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:03.843988 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:03.844158 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 10:04:03.844308 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":183,"threads_started":1}
I20260811 10:04:03.898440 22443 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:04:03.899200 22443 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:04:03.905053 22443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a: Generated new TSK 0
I20260811 10:04:03.905243 22443 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:04:04.695851 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:47573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42011
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:37555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:04.838588 22472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:04.838828 22472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:04.838874 22472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:04.840298 22472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:04.840358 22472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:04.840404 22472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:04:04.842346 22472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.127.212:47573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:04.842602 22472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:04.842854 22472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:04.849704 22478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:04.849790 22477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:04.850073 22480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:04.850248 22472 server_base.cc:1034] running on GCE node
I20260811 10:04:04.850484 22472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:04.850752 22472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:04.851960 22472 hybrid_clock.cc:648] HybridClock initialized: now 1786442644851940 us; error 41 us; skew 500 ppm
Aug 11 10:04:04 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442644, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:04.855300 22472 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:04:04.855901 22472 webserver.cc:460] Webserver started at http://127.9.127.193:34601/ using document root <none> and password file <none>
I20260811 10:04:04.856148 22472 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:04.856221 22472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:04.856388 22472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 10:04:04 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442644, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:04.873131 22472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "75e8587fa0cb49fd82cccb3f51ec8dff"
format_stamp: "Formatted at 2026-08-11 10:04:04 on dist-test-slave-1x4g"
server_key: "73be681780cf46ed6ef550fff9fec95b"
server_key_iv: "18f858930d5546dd85be50ced750c738"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:04.873586 22472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "75e8587fa0cb49fd82cccb3f51ec8dff"
format_stamp: "Formatted at 2026-08-11 10:04:04 on dist-test-slave-1x4g"
server_key: "73be681780cf46ed6ef550fff9fec95b"
server_key_iv: "18f858930d5546dd85be50ced750c738"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:04.875563 22472 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 10:04:04.890308 22488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:04.890599 22472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260811 10:04:04.890724 22472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "75e8587fa0cb49fd82cccb3f51ec8dff"
format_stamp: "Formatted at 2026-08-11 10:04:04 on dist-test-slave-1x4g"
server_key: "73be681780cf46ed6ef550fff9fec95b"
server_key_iv: "18f858930d5546dd85be50ced750c738"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:04.890841 22472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:04.907232 22472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:04.909554 22472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:04.909772 22472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:04.910104 22472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:04.910562 22472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:04.910620 22472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:04.910691 22472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:04.910723 22472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:04.923233 22472 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:41185
I20260811 10:04:04.927248 22616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:41185 every 8 connection(s)
I20260811 10:04:04.927940 22472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:04:04.937306 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 22472
I20260811 10:04:04.937446 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:04:04.937665 9727 external_mini_cluster.cc:1428] Setting key 5994423daae56cc744df7ad5d3d4e371
Aug 11 10:04:04 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442644, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:04.947432 22619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:04.929271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:49565 (local address 127.9.127.254:42011)
0811 10:04:04.932928 (+ 3657us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:04.932931 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:04.934062 (+ 1131us) server_negotiation.cc:407] Connection header received
0811 10:04:04.934099 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:04.934100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:04.934116 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:04.934184 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:04.935152 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:04.935672 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:04.936821 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:04.937044 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:04.937931 (+ 887us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:04.941358 (+ 3427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:04.941360 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:04.941360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:04.941368 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:04.943545 (+ 2177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:04.944032 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:04.944033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:04.944033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:04.944098 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:04.944345 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:04.944346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:04.944346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:04.944493 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:04.944550 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:04.947228 (+ 2678us) server_negotiation.cc:299] Negotiation successful
0811 10:04:04.947319 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3600,"thread_start_us":85,"threads_started":1}
I20260811 10:04:04.947906 22620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:04.929252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42011 (local address 127.9.127.193:49565)
0811 10:04:04.933052 (+ 3800us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:04.933103 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:04.933902 (+ 799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:04.934317 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:04.934322 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:04.934642 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:04.935028 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:04.935035 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:04.935780 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:04.935782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:04.936698 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:04.936701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:04.938022 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:04.938024 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:04.938174 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:04.938816 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:04.938827 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:04.941246 (+ 2419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:04.943639 (+ 2393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:04.943646 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:04.943649 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:04.943936 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:04.944159 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:04.944159 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:04.944160 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:04.944281 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:04.944578 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:04.944584 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:04.944738 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 10:04:04.944925 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 10:04:04.947668 (+ 2743us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3714,"thread_start_us":243,"threads_started":1}
I20260811 10:04:04.948516 22617 heartbeater.cc:347] Connected to a master server at 127.9.127.254:42011
I20260811 10:04:04.948645 22617 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:04.948899 22617 heartbeater.cc:511] Master 127.9.127.254:42011 requested a full tablet report, sending...
I20260811 10:04:04.949452 22381 ts_manager.cc:194] Registered new tserver with Master: 75e8587fa0cb49fd82cccb3f51ec8dff (127.9.127.193:41185)
I20260811 10:04:04.950124 22381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:49565
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:04:04.983855 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:47573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42011
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:37555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:05.110617 22623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:05.110864 22623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:05.110911 22623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:05.112380 22623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:05.112462 22623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:05.112512 22623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:04:05.114250 22623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.127.212:47573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:05.114558 22623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:05.114833 22623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 11 10:04:05 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786442645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 10:04:05.123354 22632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:05.123468 22634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:05.123677 22631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:05.124761 22623 server_base.cc:1034] running on GCE node
I20260811 10:04:05.125092 22623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:05.125497 22623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:05.126693 22623 hybrid_clock.cc:648] HybridClock initialized: now 1786442645126651 us; error 59 us; skew 500 ppm
Aug 11 10:04:05 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:05.130641 22623 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:04:05.131175 22623 webserver.cc:460] Webserver started at http://127.9.127.194:41207/ using document root <none> and password file <none>
I20260811 10:04:05.131502 22623 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:05.131588 22623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:05.131740 22623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 10:04:05 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:05.163093 22623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "04eb38f0eaaa4186a0c146bfdfd42801"
format_stamp: "Formatted at 2026-08-11 10:04:05 on dist-test-slave-1x4g"
server_key: "cacac2b6bf7df9b30c4bfeea3f3567a1"
server_key_iv: "9302f210efe995f26cefa123bda6db92"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:05.163648 22623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "04eb38f0eaaa4186a0c146bfdfd42801"
format_stamp: "Formatted at 2026-08-11 10:04:05 on dist-test-slave-1x4g"
server_key: "cacac2b6bf7df9b30c4bfeea3f3567a1"
server_key_iv: "9302f210efe995f26cefa123bda6db92"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:05.165498 22623 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 10:04:05.185235 22643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:05.185626 22623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:04:05.185743 22623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "04eb38f0eaaa4186a0c146bfdfd42801"
format_stamp: "Formatted at 2026-08-11 10:04:05 on dist-test-slave-1x4g"
server_key: "cacac2b6bf7df9b30c4bfeea3f3567a1"
server_key_iv: "9302f210efe995f26cefa123bda6db92"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:05.185842 22623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:05.205368 22623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:05.208081 22623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:05.208317 22623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:05.208770 22623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:05.209357 22623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:05.209432 22623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:05.209504 22623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:05.209535 22623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:05.223727 22623 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:44095
I20260811 10:04:05.224393 22623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:04:05.225452 22768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:44095 every 8 connection(s)
I20260811 10:04:05.226984 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 22623
I20260811 10:04:05.227101 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:04:05.227294 9727 external_mini_cluster.cc:1428] Setting key e0e0e89c9557d3992661d4c0151f4d8b
Aug 11 10:04:05 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:05.239214 22771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.226267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42011 (local address 127.9.127.194:40493)
0811 10:04:05.226500 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.226557 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:05.227317 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:05.228154 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:05.228168 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:05.228599 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:05.229102 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.229109 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.230197 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.230198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.231717 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.231721 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.232404 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.232405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.232560 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.233277 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:05.233289 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:05.235460 (+ 2171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:05.237538 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:05.237545 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:05.237547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:05.237838 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:05.238072 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:05.238073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:05.238073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:05.238206 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:05.238509 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:05.238515 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:05.238681 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 10:04:05.238790 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 10:04:05.238953 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
I20260811 10:04:05.239789 22619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.226587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:40493 (local address 127.9.127.254:42011)
0811 10:04:05.226658 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.226660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.226675 (+ 15us) server_negotiation.cc:407] Connection header received
0811 10:04:05.227463 (+ 788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.227464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.227480 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.227514 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:05.229220 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.230061 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.231854 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.232248 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.232329 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.235576 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:05.235578 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:05.235578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:05.235586 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:05.237440 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:05.237926 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:05.237927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:05.237928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:05.237990 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:05.238279 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:05.238280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:05.238280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:05.238422 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:05.238480 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.239578 (+ 1098us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.239683 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 10:04:05.240515 22769 heartbeater.cc:347] Connected to a master server at 127.9.127.254:42011
I20260811 10:04:05.240625 22769 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:05.240861 22769 heartbeater.cc:511] Master 127.9.127.254:42011 requested a full tablet report, sending...
I20260811 10:04:05.241313 22381 ts_manager.cc:194] Registered new tserver with Master: 04eb38f0eaaa4186a0c146bfdfd42801 (127.9.127.194:44095)
I20260811 10:04:05.241842 22381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:40493
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:04:05.263480 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:47573/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42011
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:37555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:05.419973 22774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:05.420333 22774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:05.420465 22774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:05.422358 22774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:05.422488 22774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:05.422588 22774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:04:05.424929 22774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:37555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.127.212:47573/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:42011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:05.425383 22774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:05.425683 22774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:05.432631 22780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:05.433066 22781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:05.433277 22783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:05.433615 22774 server_base.cc:1034] running on GCE node
I20260811 10:04:05.433869 22774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:05.434180 22774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:05.435400 22774 hybrid_clock.cc:648] HybridClock initialized: now 1786442645435379 us; error 34 us; skew 500 ppm
Aug 11 10:04:05 dist-test-slave-1x4g krb5kdc[21863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:05.439122 22774 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:04:05.439689 22774 webserver.cc:460] Webserver started at http://127.9.127.195:35789/ using document root <none> and password file <none>
I20260811 10:04:05.440002 22774 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:05.440119 22774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:05.440320 22774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 10:04:05 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:05.457180 22774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "0b9d5776d6c04f7e95c6ffc99b120e88"
format_stamp: "Formatted at 2026-08-11 10:04:05 on dist-test-slave-1x4g"
server_key: "7eee296f4e12b5728ad7b66d58880a65"
server_key_iv: "310683692a763d343a7a0f66adc1c9a5"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:05.457916 22774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "0b9d5776d6c04f7e95c6ffc99b120e88"
format_stamp: "Formatted at 2026-08-11 10:04:05 on dist-test-slave-1x4g"
server_key: "7eee296f4e12b5728ad7b66d58880a65"
server_key_iv: "310683692a763d343a7a0f66adc1c9a5"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:05.460510 22774 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 10:04:05.476089 22790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:05.476414 22774 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:04:05.476552 22774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "0b9d5776d6c04f7e95c6ffc99b120e88"
format_stamp: "Formatted at 2026-08-11 10:04:05 on dist-test-slave-1x4g"
server_key: "7eee296f4e12b5728ad7b66d58880a65"
server_key_iv: "310683692a763d343a7a0f66adc1c9a5"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:05.476698 22774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:05.516819 22774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:05.519941 22774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:05.520220 22774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:05.520736 22774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:05.521440 22774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:05.521528 22774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:05.521574 22774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:05.521613 22774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:05.547667 22774 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:37931
I20260811 10:04:05.548245 22774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:04:05.555575 22914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:37931 every 8 connection(s)
I20260811 10:04:05.556296 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 22774
I20260811 10:04:05.556420 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:04:05.556628 9727 external_mini_cluster.cc:1428] Setting key 54c4034564389f58a0fd9c4772a2204f
Aug 11 10:04:05 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:05.562757 22619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.549321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:57415 (local address 127.9.127.254:42011)
0811 10:04:05.549396 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.549398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.549773 (+ 375us) server_negotiation.cc:407] Connection header received
0811 10:04:05.551243 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.551245 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.551259 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.551318 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:05.552477 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.553305 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.555079 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.555441 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.555505 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.558878 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:05.558880 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:05.558880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:05.558888 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:05.560920 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:05.561493 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:05.561494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:05.561495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:05.561560 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:05.561902 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:05.561903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:05.561903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:05.562064 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:05.562115 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.562545 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.562636 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 10:04:05.563634 22917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.549118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42011 (local address 127.9.127.195:57415)
0811 10:04:05.549567 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.549623 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:05.551055 (+ 1432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:05.551619 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:05.551624 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:05.551986 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:05.552299 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.552308 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.553476 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.553477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.554963 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.554967 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.555611 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.555612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.555767 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.556490 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:05.556502 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:05.558763 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:05.561023 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:05.561030 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:05.561032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:05.561381 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:05.561646 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:05.561647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:05.561648 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:05.561813 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:05.562172 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:05.562179 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:05.562372 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 10:04:05.563122 (+ 750us) client_negotiation.cc:240] Negotiation successful
0811 10:04:05.563307 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":208,"threads_started":1}
I20260811 10:04:05.564335 22915 heartbeater.cc:347] Connected to a master server at 127.9.127.254:42011
I20260811 10:04:05.564443 22915 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:05.564651 22915 heartbeater.cc:511] Master 127.9.127.254:42011 requested a full tablet report, sending...
I20260811 10:04:05.565122 22381 ts_manager.cc:194] Registered new tserver with Master: 0b9d5776d6c04f7e95c6ffc99b120e88 (127.9.127.195:37931)
I20260811 10:04:05.565505 22381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:57415
I20260811 10:04:05.570509 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:04:05.579725 22619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.572146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53002 (local address 127.9.127.254:42011)
0811 10:04:05.572187 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.572189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.572576 (+ 387us) server_negotiation.cc:407] Connection header received
0811 10:04:05.572732 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.572733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.572746 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.572776 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:05.573463 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.573949 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.574825 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.575083 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.575155 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.576576 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:05.576577 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:05.576578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:05.576585 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:05.578407 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:05.578815 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:05.578816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:05.578817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:05.578878 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:05.579130 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:05.579131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:05.579131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:05.579259 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:05.579337 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.579553 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.579631 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:04:05.582137 22381 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53002:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:04:05.584241 22381 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:04:05.593909 22929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.586875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:37931 (local address 127.0.0.1:40346)
0811 10:04:05.588010 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.588042 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:05.588112 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:05.588866 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:05.588867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:05.588869 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:05.588904 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.588905 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.590447 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.590448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.592088 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.592091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.593610 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.593611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.593688 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.593703 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 10:04:05.593753 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:04:05.593813 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1089,"mutex_wait_us":17,"thread_start_us":85,"threads_started":1}
I20260811 10:04:05.594353 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.587582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35732 (local address 127.9.127.194:44095)
0811 10:04:05.587891 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.587897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.588440 (+ 543us) server_negotiation.cc:407] Connection header received
0811 10:04:05.588496 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.588498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.588515 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.588640 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:05.588966 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.590528 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.593026 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.593775 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.593814 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.593882 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.594220 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.594267 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":87,"threads_started":1}
I20260811 10:04:05.594827 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.587415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40346 (local address 127.9.127.195:37931)
0811 10:04:05.588644 (+ 1229us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.588648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.588660 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:04:05.588720 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.588723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.588740 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.588980 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:05.589112 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.590359 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.592659 (+ 2300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.593505 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.594374 (+ 869us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.594623 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.594650 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.594694 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1152,"thread_start_us":123,"threads_started":1}
I20260811 10:04:05.594154 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.587099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:44095 (local address 127.0.0.1:35732)
0811 10:04:05.588361 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.588367 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:05.588432 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:05.588758 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:05.588762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:05.588765 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:05.588873 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.588875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.590614 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.590615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.592907 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.592910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.593941 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.593942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.594015 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.594019 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:04:05.594068 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 10:04:05.594101 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1236,"mutex_wait_us":2,"thread_start_us":113,"threads_started":1}
I20260811 10:04:05.595732 22833 tablet_service.cc:1467] Processing CreateTablet for tablet 444df08d4d014a4699dddd51139d4098 (DEFAULT_TABLE table=test-table [id=b9f797bbc9cd47df8b2ac58b4758fad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:04:05.595839 22696 tablet_service.cc:1467] Processing CreateTablet for tablet 444df08d4d014a4699dddd51139d4098 (DEFAULT_TABLE table=test-table [id=b9f797bbc9cd47df8b2ac58b4758fad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:04:05.596164 22833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444df08d4d014a4699dddd51139d4098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:05.596164 22696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444df08d4d014a4699dddd51139d4098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:05.600955 22933 tablet_bootstrap.cc:492] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801: Bootstrap starting.
I20260811 10:04:05.602056 22933 tablet_bootstrap.cc:654] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:05.602438 22933 log.cc:824] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:05.602859 22934 tablet_bootstrap.cc:492] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: Bootstrap starting.
I20260811 10:04:05.603226 22927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.586875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:41185 (local address 127.0.0.1:47818)
0811 10:04:05.588241 (+ 1366us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.588248 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:05.588276 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:05.591209 (+ 2933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:05.591210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:05.591213 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:05.591249 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.591251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.600695 (+ 9444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.600696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.601957 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.601961 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.602994 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.602994 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.603058 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.603063 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:04:05.603097 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 10:04:05.603139 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1342,"mutex_wait_us":2,"thread_start_us":86,"threads_started":1}
I20260811 10:04:05.603889 22930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.587145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47818 (local address 127.9.127.193:41185)
0811 10:04:05.591045 (+ 3900us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.591049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.591059 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:04:05.591093 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.591095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.591110 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.591307 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:05.591365 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.592566 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.602082 (+ 9516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.602891 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.603660 (+ 769us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.603739 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.603767 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.603810 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3863,"thread_start_us":67,"threads_started":1}
I20260811 10:04:05.604677 22540 tablet_service.cc:1467] Processing CreateTablet for tablet 444df08d4d014a4699dddd51139d4098 (DEFAULT_TABLE table=test-table [id=b9f797bbc9cd47df8b2ac58b4758fad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:04:05.605046 22540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 444df08d4d014a4699dddd51139d4098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:05.605195 22933 tablet_bootstrap.cc:492] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801: No bootstrap required, opened a new log
I20260811 10:04:05.605249 22933 ts_tablet_manager.cc:1397] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 10:04:05.608003 22933 raft_consensus.cc:348] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.608172 22933 raft_consensus.cc:374] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:05.608206 22933 raft_consensus.cc:729] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04eb38f0eaaa4186a0c146bfdfd42801, State: Initialized, Role: FOLLOWER
I20260811 10:04:05.608395 22933 consensus_queue.cc:260] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.608703 22933 ts_tablet_manager.cc:1428] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 10:04:05.608952 22934 tablet_bootstrap.cc:654] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:05.609104 22769 heartbeater.cc:503] Master 127.9.127.254:42011 was elected leader, sending a full tablet report...
I20260811 10:04:05.609863 22934 log.cc:824] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:05.610843 22938 tablet_bootstrap.cc:492] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff: Bootstrap starting.
I20260811 10:04:05.612283 22938 tablet_bootstrap.cc:654] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:05.612823 22934 tablet_bootstrap.cc:492] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: No bootstrap required, opened a new log
I20260811 10:04:05.612969 22934 ts_tablet_manager.cc:1397] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260811 10:04:05.615262 22934 raft_consensus.cc:348] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.615527 22934 raft_consensus.cc:374] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:05.615598 22934 raft_consensus.cc:729] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9d5776d6c04f7e95c6ffc99b120e88, State: Initialized, Role: FOLLOWER
I20260811 10:04:05.615731 22934 consensus_queue.cc:260] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.616050 22915 heartbeater.cc:503] Master 127.9.127.254:42011 was elected leader, sending a full tablet report...
I20260811 10:04:05.616036 22934 ts_tablet_manager.cc:1428] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:04:05.617221 22938 log.cc:824] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:05.618182 22938 tablet_bootstrap.cc:492] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff: No bootstrap required, opened a new log
I20260811 10:04:05.618263 22938 ts_tablet_manager.cc:1397] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 10:04:05.621709 22938 raft_consensus.cc:348] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.621881 22938 raft_consensus.cc:374] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:05.621943 22938 raft_consensus.cc:729] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75e8587fa0cb49fd82cccb3f51ec8dff, State: Initialized, Role: FOLLOWER
I20260811 10:04:05.622080 22938 consensus_queue.cc:260] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.622486 22938 ts_tablet_manager.cc:1428] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260811 10:04:05.622560 22617 heartbeater.cc:503] Master 127.9.127.254:42011 was elected leader, sending a full tablet report...
W20260811 10:04:05.679100 22618 tablet.cc:2369] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 10:04:05 dist-test-slave-1x4g krb5kdc[21863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442645, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
W20260811 10:04:05.726531 22770 tablet.cc:2369] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:04:05.743147 22941 raft_consensus.cc:482] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:04:05.743306 22941 raft_consensus.cc:504] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.743842 22941 leader_election.cc:288] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9d5776d6c04f7e95c6ffc99b120e88 (127.9.127.195:37931), 04eb38f0eaaa4186a0c146bfdfd42801 (127.9.127.194:44095)
I20260811 10:04:05.752737 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.744293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:42077 (local address 127.9.127.195:37931)
0811 10:04:05.744359 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.744371 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.746075 (+ 1704us) server_negotiation.cc:407] Connection header received
0811 10:04:05.746185 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.746186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.746196 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.746227 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:05.746543 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.747372 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.751749 (+ 4377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.752331 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.752376 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.752385 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.752617 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.752661 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 10:04:05.753309 22942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.744234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:37931 (local address 127.9.127.193:42077)
0811 10:04:05.746004 (+ 1770us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.746018 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:05.746106 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:05.746299 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:05.746300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:05.746302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:05.746432 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.746435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.747874 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.747876 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.751645 (+ 3769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.751649 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.752447 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.752448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.752535 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.752539 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:04:05.753177 (+ 638us) client_negotiation.cc:240] Negotiation successful
0811 10:04:05.753224 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":937,"thread_start_us":174,"threads_started":1}
I20260811 10:04:05.753814 22864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "444df08d4d014a4699dddd51139d4098" candidate_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" is_pre_election: true
I20260811 10:04:05.753993 22864 raft_consensus.cc:2454] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75e8587fa0cb49fd82cccb3f51ec8dff in term 0.
I20260811 10:04:05.754271 22495 leader_election.cc:302] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9d5776d6c04f7e95c6ffc99b120e88, 75e8587fa0cb49fd82cccb3f51ec8dff; no voters:
I20260811 10:04:05.754416 22941 raft_consensus.cc:2781] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:04:05.754508 22941 raft_consensus.cc:482] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:04:05.754532 22941 raft_consensus.cc:3037] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:05.755668 22941 raft_consensus.cc:504] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.755800 22941 leader_election.cc:288] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [CANDIDATE]: Term 1 election: Requested vote from peers 0b9d5776d6c04f7e95c6ffc99b120e88 (127.9.127.195:37931), 04eb38f0eaaa4186a0c146bfdfd42801 (127.9.127.194:44095)
I20260811 10:04:05.756009 22864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "444df08d4d014a4699dddd51139d4098" candidate_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88"
I20260811 10:04:05.756100 22864 raft_consensus.cc:3037] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:05.757364 22864 raft_consensus.cc:2454] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75e8587fa0cb49fd82cccb3f51ec8dff in term 1.
I20260811 10:04:05.757576 22495 leader_election.cc:302] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9d5776d6c04f7e95c6ffc99b120e88, 75e8587fa0cb49fd82cccb3f51ec8dff; no voters:
I20260811 10:04:05.757695 22941 raft_consensus.cc:2781] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:04:05.757828 22941 raft_consensus.cc:686] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [term 1 LEADER]: Becoming Leader. State: Replica: 75e8587fa0cb49fd82cccb3f51ec8dff, State: Running, Role: LEADER
I20260811 10:04:05.757912 22941 consensus_queue.cc:237] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } }
I20260811 10:04:05.758766 22381 catalog_manager.cc:5495] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff reported cstate change: term changed from 0 to 1, leader changed from <none> to 75e8587fa0cb49fd82cccb3f51ec8dff (127.9.127.193). New cstate: current_term: 1 leader_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 41185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 } health_report { overall_health: UNKNOWN } } }
I20260811 10:04:05.761013 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.744628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:33489 (local address 127.9.127.194:44095)
0811 10:04:05.744677 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.744679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.752068 (+ 7389us) server_negotiation.cc:407] Connection header received
0811 10:04:05.752318 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.752319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.752333 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.752366 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:05.753162 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.753791 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.759299 (+ 5508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.759873 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.759924 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.759934 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.760886 (+ 952us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.760936 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 10:04:05.761703 22943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.744543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:44095 (local address 127.9.127.193:33489)
0811 10:04:05.752000 (+ 7457us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.752012 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:05.752097 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:05.752869 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:05.752870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:05.752872 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:05.753072 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.753074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.754033 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.754034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.758735 (+ 4701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:05.758739 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.760706 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.760707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:05.760779 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.760783 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:04:05.761558 (+ 775us) client_negotiation.cc:240] Negotiation successful
0811 10:04:05.761609 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7410,"thread_start_us":147,"threads_started":1}
I20260811 10:04:05.762157 22718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "444df08d4d014a4699dddd51139d4098" candidate_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" is_pre_election: true
I20260811 10:04:05.762310 22718 raft_consensus.cc:2454] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75e8587fa0cb49fd82cccb3f51ec8dff in term 0.
I20260811 10:04:05.762462 22717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "444df08d4d014a4699dddd51139d4098" candidate_uuid: "75e8587fa0cb49fd82cccb3f51ec8dff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04eb38f0eaaa4186a0c146bfdfd42801"
I20260811 10:04:05.762531 22717 raft_consensus.cc:3037] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:05.763549 22717 raft_consensus.cc:2454] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75e8587fa0cb49fd82cccb3f51ec8dff in term 1.
I20260811 10:04:05.773445 22930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.769896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47820 (local address 127.9.127.193:41185)
0811 10:04:05.769943 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:05.769945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:05.769954 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:04:05.770001 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:05.770002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:05.770025 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:05.770105 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:04:05.770276 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.770976 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.772202 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:05.772483 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:05.772547 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:05.772749 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:04:05.772913 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:04:05.773001 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:05.773231 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 10:04:05.773252 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 10:04:05.778115 22717 raft_consensus.cc:1261] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801 [term 1 FOLLOWER]: Refusing update from remote peer 75e8587fa0cb49fd82cccb3f51ec8dff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:04:05.778481 22864 raft_consensus.cc:1261] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 1 FOLLOWER]: Refusing update from remote peer 75e8587fa0cb49fd82cccb3f51ec8dff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:04:05.778995 22941 consensus_queue.cc:1035] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [LEADER]: Connected to new peer: Peer: permanent_uuid: "04eb38f0eaaa4186a0c146bfdfd42801" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 44095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:04:05.779157 22941 consensus_queue.cc:1035] T 444df08d4d014a4699dddd51139d4098 P 75e8587fa0cb49fd82cccb3f51ec8dff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9d5776d6c04f7e95c6ffc99b120e88" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:04:05.783692 22947 mvcc.cc:205] Tried to move back new op lower bound from 7317269077103259648 to 7317269077024980992. Current Snapshot: MvccSnapshot[applied={T|T < 7317269077103259648}]
I20260811 10:04:05.785853 22948 mvcc.cc:205] Tried to move back new op lower bound from 7317269077103259648 to 7317269077024980992. Current Snapshot: MvccSnapshot[applied={T|T < 7317269077103259648}]
I20260811 10:04:05.789923 22381 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:04:05.790040 22381 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53002:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:04:05.790601 22951 mvcc.cc:205] Tried to move back new op lower bound from 7317269077103259648 to 7317269077024980992. Current Snapshot: MvccSnapshot[applied={T|T < 7317269077103259648}]
I20260811 10:04:05.790940 22381 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0619c3af6f084bd29cb668a65a1bb49a: Sending DeleteTablet for 3 replicas of tablet 444df08d4d014a4699dddd51139d4098
I20260811 10:04:05.791471 22540 tablet_service.cc:1514] Processing DeleteTablet for tablet 444df08d4d014a4699dddd51139d4098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:04:05 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:47818
I20260811 10:04:05.791895 22833 tablet_service.cc:1514] Processing DeleteTablet for tablet 444df08d4d014a4699dddd51139d4098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:04:05 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:40346
I20260811 10:04:05.792297 22696 tablet_service.cc:1514] Processing DeleteTablet for tablet 444df08d4d014a4699dddd51139d4098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:04:05 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:35732
I20260811 10:04:05.792933 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 22472
I20260811 10:04:05.799245 22959 tablet_replica.cc:330] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: stopping tablet replica
I20260811 10:04:05.799444 22960 tablet_replica.cc:330] T 444df08d4d014a4699dddd51139d4098 P 04eb38f0eaaa4186a0c146bfdfd42801: stopping tablet replica
W20260811 10:04:05.802474 22366 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:41185 (error 108)
I20260811 10:04:05.802891 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 22623
I20260811 10:04:05.807152 22959 raft_consensus.cc:2229] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:04:05.807327 22959 raft_consensus.cc:2258] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:04:05.807945 22959 ts_tablet_manager.cc:1905] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:04:05.810027 22959 ts_tablet_manager.cc:1918] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:04:05.810170 22959 log.cc:1196] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/444df08d4d014a4699dddd51139d4098
I20260811 10:04:05.810904 22959 ts_tablet_manager.cc:1939] T 444df08d4d014a4699dddd51139d4098 P 0b9d5776d6c04f7e95c6ffc99b120e88: Deleting consensus metadata
I20260811 10:04:05.811510 22367 catalog_manager.cc:4841] TS 0b9d5776d6c04f7e95c6ffc99b120e88 (127.9.127.195:37931): tablet 444df08d4d014a4699dddd51139d4098 (table test-table [id=b9f797bbc9cd47df8b2ac58b4758fad7]) successfully deleted
I20260811 10:04:05.813186 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 22774
I20260811 10:04:05.815979 22927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.815836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:41185 (local address 127.0.0.1:47836)
0811 10:04:05.815893 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.815937 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:41185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 10:04:05.816121 22366 catalog_manager.cc:4584] TS 75e8587fa0cb49fd82cccb3f51ec8dff (127.9.127.193:41185): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 444df08d4d014a4699dddd51139d4098: Network error: Client connection negotiation failed: client connection to 127.9.127.193:41185: connect: Connection refused (error 111)
I20260811 10:04:05.816434 22927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:05.816269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:44095 (local address 127.0.0.1:35738)
0811 10:04:05.816382 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:05.816411 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.194:44095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 10:04:05.821655 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 22347
I20260811 10:04:05.829344 9727 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 10:04:06.173640 9727 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 10:04:06.173745 9727 mini_ranger.cc:66] Stopping Ranger...
I20260811 10:04:06.517625 9727 mini_ranger.cc:68] Stopped Ranger
2026-08-11 10:04:06.517 UTC [21895] LOG: received smart shutdown request
2026-08-11 10:04:06.521 UTC [21895] LOG: background worker "logical replication launcher" (PID 21904) exited with exit code 1
2026-08-11 10:04:06.522 UTC [21899] LOG: shutting down
2026-08-11 10:04:06.675 UTC [21895] LOG: database system is shut down
2026-08-11T10:04:06Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47363 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:04:06 dist-test-slave-1x4g krb5kdc[22974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:04:06 dist-test-slave-1x4g krb5kdc[22974](info): set up 2 sockets
Aug 11 10:04:06 dist-test-slave-1x4g krb5kdc[22974](info): commencing operation
krb5kdc: starting...
W20260811 10:04:07.843989 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:04:07 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:04:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:04:07Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.9.127.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.9.127.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/rangeradmin_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/rangeradmin_127.9.127.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.9.127.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.9.127.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/rangerlookup_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/rangerlookup_127.9.127.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.127.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.9.127.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/HTTP_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/HTTP_127.9.127.212@KRBTEST.COM.keytab.
I20260811 10:04:07.999152 9727 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskwRyaEw/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/postgres -l logfile start
2026-08-11 10:04:10.336 UTC [23007] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 10:04:10.336 UTC [23007] LOG: listening on IPv4 address "127.9.127.212", port 55893
2026-08-11 10:04:10.340 UTC [23007] LOG: listening on Unix socket "/tmp/.s.PGSQL.55893"
2026-08-11 10:04:10.360 UTC [23011] LOG: database system was shut down at 2026-08-11 10:04:09 UTC
2026-08-11 10:04:10.364 UTC [23007] LOG: database system is ready to accept connections
I20260811 10:04:11.353438 9727 mini_postgres.cc:96] Postgres bound to 55893
2026-08-11 10:04:11.360 UTC [23019] FATAL: database "slave" does not exist
127.9.127.212:55893 - accepting connections
I20260811 10:04:11.360857 9727 mini_ranger.cc:161] Starting Ranger...
I20260811 10:04:11.376600 9727 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 10:04:11.795126 9727 mini_ranger.cc:87] Created ranger Postgres database
I20260811 10:04:11.795217 9727 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-admin
2026-08-11 10:04:12,072 [I] DB FLAVOR :POSTGRES
2026-08-11 10:04:12,073 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 10:04:12,073 [I] Checking connection..
2026-08-11 10:04:12,073 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 10:04:12,327 [I] Checking connection passed.
2026-08-11 10:04:12,327 [I] --------- Verifying version history table ---------
2026-08-11 10:04:12,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 10:04:12,592 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 10:04:12,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 10:04:12,850 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 10:04:12,850 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 10:04:12,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 10:04:13.099 UTC [23087] WARNING: there is no transaction in progress
2026-08-11 10:04:13,107 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 10:04:13,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 10:04:13,353 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 10:04:13,353 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 10:04:13,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 10:04:13,607 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 10:04:13,834 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1x4g.c.gcp-upstream.internal','N') ;"
2026-08-11 10:04:14,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 10:04:14,325 [I] Table x_portal_user does not exist in database ranger
2026-08-11 10:04:14,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 10:04:14,581 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 10:04:14,581 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 10:04:14,818 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 10:04:15,039 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 10:04:15,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 10:04:15.935 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:15.951 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:15.966 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:15.981 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:15.998 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.016 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.078 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.084 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.097 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.106 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.116 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.127 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.137 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.142 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.148 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16.154 UTC [23206] WARNING: there is no transaction in progress
2026-08-11 10:04:16,728 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 10:04:16,729 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 10:04:16,946 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 10:04:16,946 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 10:04:17,171 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 10:04:17,171 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 10:04:17,430 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 10:04:17,431 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 10:04:17,673 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 10:04:17,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1x4g.c.gcp-upstream.internal';"
2026-08-11 10:04:18,172 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 10:04:18,172 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 10:04:18,397 [I] DB_PATCHES have already been applied
I20260811 10:04:18.402823 9727 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-admin:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskwRyaEw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 10:04:18.402912 9727 mini_ranger.cc:193] Using host: 127.9.127.212
I20260811 10:04:18.406777 9727 mini_ranger.cc:227] Ranger admin URL: http://127.9.127.212:43981
Aug 11, 2026 10:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 10:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 10:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 10:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 10:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 10:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 10:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 10:04:19.576459 9727 mini_ranger.cc:160] Time spent starting Ranger: real 8.216s user 0.000s sys 0.010s
Aug 11, 2026 10:04:40 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 10:04:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 10:04:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 10:04:40 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 10:04:41 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 10:04:42.298839 9727 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.9.127.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.9.127.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/rangerkms_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.9.127.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/rangerkms_127.9.127.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.9.127.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.9.127.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.9.127.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/HTTP_127.9.127.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.9.127.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/HTTP_127.9.127.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 10:04:42 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442682, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 10:04:42.387269 9727 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 10:04:42.397183 9727 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 10:04:43.233042 9727 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 10:04:43.233139 9727 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms
I20260811 10:04:43.233160 9727 mini_ranger_kms.cc:227] Using postgres at 127.9.127.212:55893
2026-08-11 10:04:43,426 [I] DB FLAVOR :POSTGRES
2026-08-11 10:04:43,427 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 10:04:43,427 [I] Checking connection
2026-08-11 10:04:43,427 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 10:04:43,720 [I] connection success
2026-08-11 10:04:43,720 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 10:04:43,720 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 10:04:43,720 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 10:04:43,956 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 10:04:43,957 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 10:04:43,957 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 10:04:43,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.9.127.212:55893/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 10:04:44,229 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 10:04:44.723850 9727 mini_ranger_kms.cc:310] Created kms service
I20260811 10:04:44.963088 9727 mini_ranger_kms.cc:326] Created kudu user
I20260811 10:04:45.009436 9727 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 10:04:45 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442682, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:45.424170 9727 mini_ranger_kms.cc:384] Added ranger policy
I20260811 10:04:45.424300 9727 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms:/tmp/dist-test-taskwRyaEw/build/release/bin/postgresql.jar:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskwRyaEw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 10:04:45.424319 9727 mini_ranger_kms.cc:240] Using host: 127.9.127.212
I20260811 10:04:45.430109 9727 mini_ranger_kms.cc:276] Ranger KMS PID: 23405
I20260811 10:04:45.430202 9727 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.9.127.212:46947
Aug 11, 2026 10:04:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 10:04:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 10:04:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 10:04:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 10:04:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 10:04:46 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 10:04:47 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786442687, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.127.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:47.804688 9727 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.417s user 0.000s sys 0.172s
I20260811 10:04:47.804811 9727 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 10:04:47.804864 9727 mini_ranger_kms.cc:401] 127.9.127.212:46947/kms/v1/keys
Aug 11 10:04:48 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442687, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.127.212@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
Aug 11 10:04:48 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442687, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.9.127.212@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
Aug 11 10:04:50 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:04:50.763988 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33793
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:33793
--ranger_config_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:46947/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:50.852123 23460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:50.852330 23460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:50.852352 23460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:50.853577 23460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:04:50.853623 23460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:50.853637 23460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:50.853650 23460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:04:50.853663 23460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:04:50.855299 23460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
--ranger_kms_url=127.9.127.212:46947/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:33793
--ranger_config_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:50.855551 23460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:50.855798 23460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:50.860826 23465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:50.860838 23466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:50.861043 23468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:50.861238 23460 server_base.cc:1034] running on GCE node
I20260811 10:04:50.861482 23460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:50.861833 23460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:50.863003 23460 hybrid_clock.cc:648] HybridClock initialized: now 1786442690862978 us; error 42 us; skew 500 ppm
Aug 11 10:04:50 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442690, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:50.870412 23460 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:04:50.870921 23460 webserver.cc:460] Webserver started at http://127.9.127.254:42221/ using document root <none> and password file <none>
I20260811 10:04:50.871184 23460 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:50.871227 23460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:50.871369 23460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 10:04:50 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442690, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:50.917553 23460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "6317b7be1f734753862ffdcedb15ce26"
format_stamp: "Formatted at 2026-08-11 10:04:50 on dist-test-slave-1x4g"
server_key: "bb2fc2269cca83623c30f9835736b23f"
server_key_iv: "8c9a1ed83db3495117e99728bc766fa7"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:50.918210 23460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "6317b7be1f734753862ffdcedb15ce26"
format_stamp: "Formatted at 2026-08-11 10:04:50 on dist-test-slave-1x4g"
server_key: "bb2fc2269cca83623c30f9835736b23f"
server_key_iv: "8c9a1ed83db3495117e99728bc766fa7"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:50.919966 23460 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:04:50.934303 23478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:50.934641 23460 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:04:50.934751 23460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6317b7be1f734753862ffdcedb15ce26"
format_stamp: "Formatted at 2026-08-11 10:04:50 on dist-test-slave-1x4g"
server_key: "bb2fc2269cca83623c30f9835736b23f"
server_key_iv: "8c9a1ed83db3495117e99728bc766fa7"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:50.934842 23460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:50.956301 23460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:50.958438 23460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:50.958621 23460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:50.963202 23460 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:33793
I20260811 10:04:50.963255 23535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:33793 every 8 connection(s)
I20260811 10:04:50.963624 23460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:04:50.964490 23536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:50.967739 23536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Bootstrap starting.
I20260811 10:04:50.968482 23536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:50.968825 23536 log.cc:824] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:50.969635 23536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: No bootstrap required, opened a new log
I20260811 10:04:50.970750 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 23460
I20260811 10:04:50.970862 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:04:50.971066 9727 external_mini_cluster.cc:1428] Setting key 9105e80cb6e0a948161ad3a97d1c9815
I20260811 10:04:50.972584 23536 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } }
I20260811 10:04:50.972834 23536 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:50.972999 23536 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6317b7be1f734753862ffdcedb15ce26, State: Initialized, Role: FOLLOWER
I20260811 10:04:50.973160 23536 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } }
I20260811 10:04:50.973256 23536 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:04:50.973294 23536 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:04:50.973372 23536 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:50.974085 23536 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } }
I20260811 10:04:50.974201 23536 leader_election.cc:302] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6317b7be1f734753862ffdcedb15ce26; no voters:
I20260811 10:04:50.974416 23536 leader_election.cc:288] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:04:50.974467 23541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:04:50.974714 23541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 1 LEADER]: Becoming Leader. State: Replica: 6317b7be1f734753862ffdcedb15ce26, State: Running, Role: LEADER
I20260811 10:04:50.974767 23536 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:04:50.974839 23541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } }
I20260811 10:04:50.975234 23541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6317b7be1f734753862ffdcedb15ce26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } } }
I20260811 10:04:50.975380 23541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:50.975591 23541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6317b7be1f734753862ffdcedb15ce26. Latest consensus state: current_term: 1 leader_uuid: "6317b7be1f734753862ffdcedb15ce26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } } }
I20260811 10:04:50.975696 23541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:50.975847 23549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:04:50.976367 23549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 10:04:50 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:50.980281 23549 catalog_manager.cc:1347] Generated new cluster ID: c70e48a485d6415c9d00c770d6f0e686
I20260811 10:04:50.980329 23549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:04:50.982860 23536 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 10:04:50.987088 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:50.971605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46890 (local address 127.9.127.254:33793)
0811 10:04:50.971767 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:50.971778 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:50.971874 (+ 96us) server_negotiation.cc:407] Connection header received
0811 10:04:50.972556 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:50.972564 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:50.972615 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:50.972769 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:50.973690 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:50.974919 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:50.976039 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:50.976678 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:50.978483 (+ 1805us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:50.979705 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:50.979709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:50.979710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:50.979721 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:50.981621 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:50.981984 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:50.981987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:50.981987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:50.982515 (+ 528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:50.982710 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:50.982710 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:50.982711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:50.982987 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:50.983123 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:50.985537 (+ 2414us) server_negotiation.cc:299] Negotiation successful
0811 10:04:50.986637 (+ 1100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
I20260811 10:04:50.996582 23549 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:04:50.997494 23549 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:04:51.004878 23549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Generated new TSK 0
I20260811 10:04:51.005134 23549 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:04:51.751863 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:46947/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33793
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:51.893024 23585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:51.893251 23585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:51.893294 23585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:51.894552 23585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:51.894601 23585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:51.894649 23585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:04:51.896203 23585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.9.127.212:46947/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:51.896481 23585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:51.896727 23585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:51.902709 23590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:51.902746 23593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:51.902835 23591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:51.903679 23585 server_base.cc:1034] running on GCE node
I20260811 10:04:51.903872 23585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:51.904139 23585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:51.905308 23585 hybrid_clock.cc:648] HybridClock initialized: now 1786442691905281 us; error 38 us; skew 500 ppm
Aug 11 10:04:51 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442691, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:51.909032 23585 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:04:51.909543 23585 webserver.cc:460] Webserver started at http://127.9.127.193:42167/ using document root <none> and password file <none>
I20260811 10:04:51.909857 23585 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:51.909930 23585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:51.910135 23585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 10:04:51 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442691, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:51.927217 23585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "172a3e1b57e942f08a7abb626cbde245"
format_stamp: "Formatted at 2026-08-11 10:04:51 on dist-test-slave-1x4g"
server_key: "98505eb384b3bfd8643227c5e4760efb"
server_key_iv: "38b616d928e9e83ae4cd132351b17a2c"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:51.927924 23585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "172a3e1b57e942f08a7abb626cbde245"
format_stamp: "Formatted at 2026-08-11 10:04:51 on dist-test-slave-1x4g"
server_key: "98505eb384b3bfd8643227c5e4760efb"
server_key_iv: "38b616d928e9e83ae4cd132351b17a2c"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:51.930634 23585 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 10:04:51.947675 23601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:51.947971 23585 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:04:51.948086 23585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "172a3e1b57e942f08a7abb626cbde245"
format_stamp: "Formatted at 2026-08-11 10:04:51 on dist-test-slave-1x4g"
server_key: "98505eb384b3bfd8643227c5e4760efb"
server_key_iv: "38b616d928e9e83ae4cd132351b17a2c"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:51.948195 23585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:51.973845 23585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:51.976550 23585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:51.976823 23585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:51.977171 23585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:51.977638 23585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:51.977735 23585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:51.977837 23585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:51.977922 23585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:51.993456 23585 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:38591
I20260811 10:04:51.994033 23585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:04:51.997041 23721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:38591 every 8 connection(s)
I20260811 10:04:52.000542 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 23585
I20260811 10:04:52.000654 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:04:52.000943 9727 external_mini_cluster.cc:1428] Setting key b27a7499ae9995f24e180defce5c24d1
Aug 11 10:04:51 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442691, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:52.007660 23724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:51.995122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33793 (local address 127.9.127.193:35917)
0811 10:04:51.995689 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:51.995743 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:51.996753 (+ 1010us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:51.997141 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:51.997146 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:51.997514 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:51.997804 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:51.997809 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:51.998559 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:51.998560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:51.999460 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:51.999463 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:51.999932 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:51.999933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:52.000055 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:52.000678 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:52.000689 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:52.003074 (+ 2385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:52.005771 (+ 2697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:52.005778 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:52.005781 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:52.006091 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:52.006460 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:52.006461 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:52.006462 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:52.006600 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:52.006895 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:52.006901 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:52.007063 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 10:04:52.007153 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 10:04:52.007319 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":187,"threads_started":1}
I20260811 10:04:52.008167 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:51.995509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:35917 (local address 127.9.127.254:33793)
0811 10:04:51.995746 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:51.995748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:51.995882 (+ 134us) server_negotiation.cc:407] Connection header received
0811 10:04:51.996910 (+ 1028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:51.996911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:51.996923 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:51.997041 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:51.997925 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:51.998458 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:51.999560 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:51.999784 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:51.999871 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:52.003184 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:52.003186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:52.003186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:52.003194 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:52.005659 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:52.006292 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:52.006293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:52.006293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:52.006363 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:52.006680 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:52.006681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:52.006681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:52.006820 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:52.007932 (+ 1112us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:52.007980 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 10:04:52.008070 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":154,"threads_started":1}
I20260811 10:04:52.009086 23722 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33793
I20260811 10:04:52.009207 23722 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:52.009398 23722 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:52.010054 23496 ts_manager.cc:194] Registered new tserver with Master: 172a3e1b57e942f08a7abb626cbde245 (127.9.127.193:38591)
I20260811 10:04:52.010680 23496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:35917
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:04:52.039538 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:46947/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33793
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:52.200800 23729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:52.201122 23729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:52.201172 23729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:52.203156 23729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:52.203224 23729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:52.203280 23729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:04:52.205838 23729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.9.127.212:46947/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:52.206125 23729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:52.206465 23729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 10:04:52.213146 23738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:52.213327 23740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:52.213581 23729 server_base.cc:1034] running on GCE node
W20260811 10:04:52.213162 23737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:52.213869 23729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:52.214169 23729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:52.215327 23729 hybrid_clock.cc:648] HybridClock initialized: now 1786442692215314 us; error 26 us; skew 500 ppm
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:52.218806 23729 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:04:52.219310 23729 webserver.cc:460] Webserver started at http://127.9.127.194:39071/ using document root <none> and password file <none>
I20260811 10:04:52.219563 23729 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:52.219636 23729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:52.219789 23729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:52.239439 23729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "95a581fa4a8d4e30a36145bbfc01760a"
format_stamp: "Formatted at 2026-08-11 10:04:52 on dist-test-slave-1x4g"
server_key: "64fb7ee6b0525fd879f4dd8282069c0f"
server_key_iv: "8823d74afa72312320f7a3a0816e6ccb"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:52.240214 23729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "95a581fa4a8d4e30a36145bbfc01760a"
format_stamp: "Formatted at 2026-08-11 10:04:52 on dist-test-slave-1x4g"
server_key: "64fb7ee6b0525fd879f4dd8282069c0f"
server_key_iv: "8823d74afa72312320f7a3a0816e6ccb"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:52.242501 23729 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 10:04:52.259361 23748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:52.259634 23729 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260811 10:04:52.259744 23729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "95a581fa4a8d4e30a36145bbfc01760a"
format_stamp: "Formatted at 2026-08-11 10:04:52 on dist-test-slave-1x4g"
server_key: "64fb7ee6b0525fd879f4dd8282069c0f"
server_key_iv: "8823d74afa72312320f7a3a0816e6ccb"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:52.259859 23729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:52.277737 23729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:52.280114 23729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:52.280308 23729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:52.280632 23729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:52.281225 23729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:52.281275 23729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:52.281304 23729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:52.281323 23729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:52.294915 23729 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:39893
I20260811 10:04:52.295123 23868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:39893 every 8 connection(s)
I20260811 10:04:52.295449 23729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:04:52.299082 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 23729
I20260811 10:04:52.299203 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:04:52.299427 9727 external_mini_cluster.cc:1428] Setting key 4ed154cc9a7875f253def7a8a82cb625
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:52.308867 23871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:52.296457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33793 (local address 127.9.127.194:43081)
0811 10:04:52.296708 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:52.296752 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:52.297471 (+ 719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:52.297749 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:52.297752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:52.298082 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:52.298375 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:52.298380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:52.299420 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:52.299421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:52.300915 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:52.300919 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:52.301547 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:52.301548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:52.301733 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:52.302503 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:52.302514 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:52.304492 (+ 1978us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:52.306720 (+ 2228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:52.306727 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:52.306730 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:52.307176 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:52.307479 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:52.307480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:52.307481 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:52.307633 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:52.308004 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:52.308020 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:52.308187 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 10:04:52.308309 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 10:04:52.308543 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":170,"threads_started":1}
I20260811 10:04:52.309230 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:52.296485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:43081 (local address 127.9.127.254:33793)
0811 10:04:52.296581 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:52.296583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:52.296856 (+ 273us) server_negotiation.cc:407] Connection header received
0811 10:04:52.297589 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:52.297590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:52.297606 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:52.297695 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:52.298489 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:52.299311 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:52.301069 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:52.301389 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:52.301478 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:52.304596 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:52.304598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:52.304599 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:52.304608 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:52.306626 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:52.307301 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:52.307303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:52.307304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:52.307372 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:52.307716 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:52.307717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:52.307717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:52.307878 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:52.307972 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:52.309029 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0811 10:04:52.309120 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 10:04:52.309916 23869 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33793
I20260811 10:04:52.310029 23869 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:52.310262 23869 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:52.310765 23496 ts_manager.cc:194] Registered new tserver with Master: 95a581fa4a8d4e30a36145bbfc01760a (127.9.127.194:39893)
I20260811 10:04:52.311321 23496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:43081
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:04:52.332311 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:46947/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33793
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:52.454418 23876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:52.454658 23876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:52.454695 23876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:52.456032 23876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:52.456105 23876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:52.456153 23876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:04:52.457741 23876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.9.127.212:46947/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:52.458006 23876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:52.458279 23876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:52.464119 23882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:52.464376 23884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:52.464047 23881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:52.465314 23876 server_base.cc:1034] running on GCE node
I20260811 10:04:52.465523 23876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:52.465790 23876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:52.466943 23876 hybrid_clock.cc:648] HybridClock initialized: now 1786442692466929 us; error 25 us; skew 500 ppm
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:52.470078 23876 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:04:52.470567 23876 webserver.cc:460] Webserver started at http://127.9.127.195:40799/ using document root <none> and password file <none>
I20260811 10:04:52.470798 23876 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:52.470866 23876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:52.471009 23876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:52.486707 23876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "303c09e64c6a4a25a701ecdfe75fc5a6"
format_stamp: "Formatted at 2026-08-11 10:04:52 on dist-test-slave-1x4g"
server_key: "29cb23719c9e6529bade22f89bc8ef5f"
server_key_iv: "a687c970a123ca3f6403cc5dc4926472"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:52.487277 23876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "303c09e64c6a4a25a701ecdfe75fc5a6"
format_stamp: "Formatted at 2026-08-11 10:04:52 on dist-test-slave-1x4g"
server_key: "29cb23719c9e6529bade22f89bc8ef5f"
server_key_iv: "a687c970a123ca3f6403cc5dc4926472"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:52.501356 23876 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.004s sys 0.000s
I20260811 10:04:52.516901 23892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:52.517113 23876 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 10:04:52.517221 23876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "303c09e64c6a4a25a701ecdfe75fc5a6"
format_stamp: "Formatted at 2026-08-11 10:04:52 on dist-test-slave-1x4g"
server_key: "29cb23719c9e6529bade22f89bc8ef5f"
server_key_iv: "a687c970a123ca3f6403cc5dc4926472"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:52.517338 23876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:52.541669 23876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:52.544319 23876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:52.544486 23876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:52.544757 23876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:52.545186 23876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:52.545243 23876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:52.545284 23876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:52.545323 23876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:52.563621 23876 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:37521
I20260811 10:04:52.564260 23876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:04:52.572361 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 23876
I20260811 10:04:52.572479 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:04:52.572685 9727 external_mini_cluster.cc:1428] Setting key 03e1095bb6b44f0390f408d2b1e2c575
I20260811 10:04:52.564985 24015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:37521 every 8 connection(s)
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:52.593143 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:52.566559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:46705 (local address 127.9.127.254:33793)
0811 10:04:52.566606 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:52.566608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:52.580751 (+ 14143us) server_negotiation.cc:407] Connection header received
0811 10:04:52.581814 (+ 1063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:52.581815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:52.581829 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:52.581860 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:52.583187 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:52.583964 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:52.585744 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:52.586097 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:52.586205 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:52.589487 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:52.589488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:52.589489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:52.589503 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:52.591275 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:52.591856 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:52.591858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:52.591858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:52.591926 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:52.592291 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:52.592292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:52.592292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:52.592443 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:52.592517 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:52.592942 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 10:04:52.593030 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:04:52.593358 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:52.566120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33793 (local address 127.9.127.195:46705)
0811 10:04:52.580530 (+ 14410us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:52.580602 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:52.581673 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:52.582071 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:52.582076 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:52.582598 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:52.583047 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:52.583054 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:52.584089 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:52.584090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:52.585631 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:52.585635 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:52.586313 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:52.586314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:52.586507 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:52.587285 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:52.587296 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:52.589361 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:52.591373 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:52.591380 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:52.591382 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:52.591730 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:52.592007 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:52.592008 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:52.592008 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:52.592185 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:52.592532 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:52.592539 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:52.592725 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 10:04:52.592882 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 10:04:52.593067 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14330,"thread_start_us":205,"threads_started":1}
I20260811 10:04:52.594094 24016 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33793
I20260811 10:04:52.594223 24016 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:52.594427 24016 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:52.594928 23496 ts_manager.cc:194] Registered new tserver with Master: 303c09e64c6a4a25a701ecdfe75fc5a6 (127.9.127.195:37521)
I20260811 10:04:52.595472 23496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:46705
I20260811 10:04:52.595641 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:04:52.596397 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 23585
I20260811 10:04:52.602815 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 23729
I20260811 10:04:52.613574 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 23876
I20260811 10:04:52.620116 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 23460
I20260811 10:04:52.634744 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33793
--webserver_interface=127.9.127.254
--webserver_port=42221
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:33793
--ranger_config_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:46947/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.127.212:46947/kms with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:52.719521 24019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:52.719774 24019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:52.719830 24019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:52.721025 24019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:04:52.721067 24019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:52.721081 24019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:52.721094 24019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:04:52.721107 24019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:04:52.722688 24019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.127.212:46947/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:33793
--ranger_config_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=42221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:52.722929 24019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:52.723199 24019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:52.728214 24025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:52.728220 24024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:52.728322 24027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:52.728412 24019 server_base.cc:1034] running on GCE node
I20260811 10:04:52.728991 24019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:52.729302 24019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:52.730471 24019 hybrid_clock.cc:648] HybridClock initialized: now 1786442692730445 us; error 42 us; skew 500 ppm
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:52.733477 24019 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:04:52.733949 24019 webserver.cc:460] Webserver started at http://127.9.127.254:42221/ using document root <none> and password file <none>
I20260811 10:04:52.734179 24019 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:52.734264 24019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:52.813570 24019 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:04:52.814491 24036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:52.814718 24019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:04:52.814824 24019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6317b7be1f734753862ffdcedb15ce26"
format_stamp: "Formatted at 2026-08-11 10:04:50 on dist-test-slave-1x4g"
server_key: "bb2fc2269cca83623c30f9835736b23f"
server_key_iv: "8c9a1ed83db3495117e99728bc766fa7"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:52.815276 24019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:52.850764 24019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:52.852924 24019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:52.853075 24019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:52.858130 24019 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:33793
I20260811 10:04:52.858165 24091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:33793 every 8 connection(s)
I20260811 10:04:52.858604 24019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:04:52.859905 24092 sys_catalog.cc:263] Verifying existing consensus state
I20260811 10:04:52.860596 24092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Bootstrap starting.
I20260811 10:04:52.861806 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 24019
I20260811 10:04:52.862119 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:46947/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:38591
--local_ip_for_outbound_sockets=127.9.127.193
--tserver_master_addrs=127.9.127.254:33793
--webserver_port=42167
--webserver_interface=127.9.127.193
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.127.212:46947/kms with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:04:52.869619 24092 log.cc:824] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:52.871378 24092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:04:52.871701 24092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Bootstrap complete.
I20260811 10:04:52.874208 24092 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } }
I20260811 10:04:52.874457 24092 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6317b7be1f734753862ffdcedb15ce26, State: Initialized, Role: FOLLOWER
I20260811 10:04:52.874677 24092 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } }
I20260811 10:04:52.874786 24092 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:04:52.874852 24092 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:04:52.874928 24092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 1 FOLLOWER]: Advancing to term 2
I20260811 10:04:52.876025 24092 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } }
I20260811 10:04:52.876148 24092 leader_election.cc:302] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6317b7be1f734753862ffdcedb15ce26; no voters:
I20260811 10:04:52.876356 24092 leader_election.cc:288] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 10:04:52.876390 24099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 10:04:52.876608 24099 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [term 2 LEADER]: Becoming Leader. State: Replica: 6317b7be1f734753862ffdcedb15ce26, State: Running, Role: LEADER
I20260811 10:04:52.876747 24092 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:04:52.876767 24099 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } }
I20260811 10:04:52.877058 24099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6317b7be1f734753862ffdcedb15ce26. Latest consensus state: current_term: 2 leader_uuid: "6317b7be1f734753862ffdcedb15ce26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } } }
I20260811 10:04:52.877059 24102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6317b7be1f734753862ffdcedb15ce26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317b7be1f734753862ffdcedb15ce26" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33793 } } }
I20260811 10:04:52.877157 24099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:52.877161 24102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26 [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:52.877708 24104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:04:52.878271 24104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:04:52.878463 24104 catalog_manager.cc:1259] Loaded cluster ID: c70e48a485d6415c9d00c770d6f0e686
I20260811 10:04:52.878573 24104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:04:52.879061 24092 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 10:04:52.879863 24104 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:04:52.880089 24104 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Loaded TSK: 0
I20260811 10:04:52.880339 24104 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 10:04:52.979319 24095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:52.979578 24095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:52.979617 24095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:52.980937 24095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:52.980997 24095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:52.981041 24095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:04:52.982928 24095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.127.212:46947/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:38591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=42167
--tserver_master_addrs=127.9.127.254:33793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:52.983206 24095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:52.983453 24095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:52.988402 24137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:52.988411 24139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:52.988515 24135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:52.988875 24095 server_base.cc:1034] running on GCE node
I20260811 10:04:52.989078 24095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:52.989326 24095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:52.992599 24095 hybrid_clock.cc:648] HybridClock initialized: now 1786442692992567 us; error 55 us; skew 500 ppm
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:52.997644 24095 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:04:52.998175 24095 webserver.cc:460] Webserver started at http://127.9.127.193:42167/ using document root <none> and password file <none>
I20260811 10:04:52.998486 24095 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:52.998659 24095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 10:04:52 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:53.031028 24095 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.000s sys 0.001s
I20260811 10:04:53.035117 24149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.035315 24095 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260811 10:04:53.035424 24095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "172a3e1b57e942f08a7abb626cbde245"
format_stamp: "Formatted at 2026-08-11 10:04:51 on dist-test-slave-1x4g"
server_key: "98505eb384b3bfd8643227c5e4760efb"
server_key_iv: "38b616d928e9e83ae4cd132351b17a2c"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:53.035830 24095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:53.049101 24095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:53.051579 24095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:53.051784 24095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:53.052088 24095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:53.052495 24095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:53.052573 24095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.052634 24095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:53.052668 24095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.059381 24095 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:38591
I20260811 10:04:53.059942 24095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:04:53.061138 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 24095
I20260811 10:04:53.061419 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:46947/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:39893
--local_ip_for_outbound_sockets=127.9.127.194
--tserver_master_addrs=127.9.127.254:33793
--webserver_port=39071
--webserver_interface=127.9.127.194
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.127.212:46947/kms with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:04:53.069600 24274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:38591 every 8 connection(s)
Aug 11 10:04:53 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442692, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:53.088995 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:53.070384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33793 (local address 127.9.127.193:37641)
0811 10:04:53.070563 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:53.070614 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:53.071382 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:53.076105 (+ 4723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:53.076109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:53.076347 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:53.076621 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:53.076627 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.078529 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.078530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:53.079816 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:53.079820 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.080745 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.080746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:53.080906 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:53.081524 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:53.081535 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:53.084620 (+ 3085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:53.087064 (+ 2444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:53.087070 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:53.087072 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:53.087351 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:53.087692 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:53.087693 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:53.087693 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:53.087826 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:53.088306 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:53.088311 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:53.088462 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 10:04:53.088569 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 10:04:53.088734 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260811 10:04:53.089036 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:53.070709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:37641 (local address 127.9.127.254:33793)
0811 10:04:53.075506 (+ 4797us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:53.075516 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:53.075561 (+ 45us) server_negotiation.cc:407] Connection header received
0811 10:04:53.075719 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:53.075727 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:53.075786 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:53.075922 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:53.076868 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.078370 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.079913 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.080534 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.080630 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:53.084743 (+ 4113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:53.084747 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:53.084748 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:53.084759 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:53.086947 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:53.087463 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:53.087467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:53.087467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:53.087589 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:53.087906 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:53.087908 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:53.087908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:53.088216 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:53.088296 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:53.088659 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 10:04:53.088820 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4733,"thread_start_us":94,"threads_started":1}
I20260811 10:04:53.090397 24275 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33793
I20260811 10:04:53.090502 24275 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.090682 24275 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
W20260811 10:04:53.091555 24275 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:33793 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 10:04:53.091632 24275 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.091699 24275 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:53.092200 24275 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.092280 24275 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
W20260811 10:04:53.092640 24275 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 10:04:53.169539 24277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:53.169947 24277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:53.170038 24277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:53.171806 24277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:53.171922 24277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:53.172009 24277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:04:53.174141 24277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.127.212:46947/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:39893
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=39071
--tserver_master_addrs=127.9.127.254:33793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:53.174388 24277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:53.174675 24277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:53.181021 24287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:53.181226 24289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:53.181747 24286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:53.183514 24277 server_base.cc:1034] running on GCE node
I20260811 10:04:53.183727 24277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:53.183917 24277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:53.185098 24277 hybrid_clock.cc:648] HybridClock initialized: now 1786442693185080 us; error 49 us; skew 500 ppm
Aug 11 10:04:53 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:53.188349 24277 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:04:53.188875 24277 webserver.cc:460] Webserver started at http://127.9.127.194:39071/ using document root <none> and password file <none>
I20260811 10:04:53.189147 24277 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:53.189227 24277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 10:04:53 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:53.206864 24277 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:04:53.208096 24299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.208398 24277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:04:53.208539 24277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "95a581fa4a8d4e30a36145bbfc01760a"
format_stamp: "Formatted at 2026-08-11 10:04:52 on dist-test-slave-1x4g"
server_key: "64fb7ee6b0525fd879f4dd8282069c0f"
server_key_iv: "8823d74afa72312320f7a3a0816e6ccb"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:53.209224 24277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:53.221040 24277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:53.223470 24277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:53.223658 24277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:53.223943 24277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:53.224344 24277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:53.224401 24277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.224445 24277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:53.224472 24277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.232085 24277 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:39893
I20260811 10:04:53.232189 24427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:39893 every 8 connection(s)
I20260811 10:04:53.232604 24277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:04:53 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:53.239693 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 24277
I20260811 10:04:53.240005 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.9.127.212:46947/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:37521
--local_ip_for_outbound_sockets=127.9.127.195
--tserver_master_addrs=127.9.127.254:33793
--webserver_port=40799
--webserver_interface=127.9.127.195
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.9.127.212:46947/kms with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:04:53.245872 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:53.233611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:35677 (local address 127.9.127.254:33793)
0811 10:04:53.233674 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:53.233676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:53.233934 (+ 258us) server_negotiation.cc:407] Connection header received
0811 10:04:53.234609 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:53.234609 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:53.234623 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:53.234664 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:53.235448 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.236060 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.237286 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.237501 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.237578 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:53.242334 (+ 4756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:53.242335 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:53.242336 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:53.242345 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:53.244052 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:53.244606 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:53.244607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:53.244608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:53.244669 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:53.244987 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:53.244988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:53.244989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:53.245139 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:53.245182 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:53.245672 (+ 490us) server_negotiation.cc:299] Negotiation successful
0811 10:04:53.245777 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:04:53.246043 24431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:53.233566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33793 (local address 127.9.127.194:35677)
0811 10:04:53.233776 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:53.233826 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:53.234492 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:53.234757 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:53.234762 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:53.235008 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:53.235305 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:53.235313 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.236168 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.236169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:53.237182 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:53.237185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.237613 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.237615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:53.237738 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:53.238389 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:53.238397 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:53.242212 (+ 3815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:53.244141 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:53.244148 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:53.244151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:53.244514 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:53.244742 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:53.244743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:53.244743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:53.244907 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:53.245231 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:53.245238 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:53.245455 (+ 217us) client_negotiation.cc:769] Sending connection context
0811 10:04:53.245594 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 10:04:53.245780 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":97,"threads_started":1}
I20260811 10:04:53.246773 24428 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33793
I20260811 10:04:53.246898 24428 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.247116 24428 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
W20260811 10:04:53.247786 24428 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:33793 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 10:04:53.247862 24428 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.247932 24428 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:53.248319 24428 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.248442 24428 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
W20260811 10:04:53.248860 24428 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 10:04:53.337633 24432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:53.337867 24432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:53.337906 24432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:53.339263 24432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:53.339327 24432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:53.339370 24432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:04:53.341068 24432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.9.127.212:46947/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:37521
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=40799
--tserver_master_addrs=127.9.127.254:33793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:53.341526 24432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:53.341861 24432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:53.348436 24439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:53.348810 24432 server_base.cc:1034] running on GCE node
W20260811 10:04:53.349102 24438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:53.351320 24441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:53.351603 24432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:53.351907 24432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:53.353098 24432 hybrid_clock.cc:648] HybridClock initialized: now 1786442693353086 us; error 28 us; skew 500 ppm
Aug 11 10:04:53 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:53.356294 24432 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:04:53.356851 24432 webserver.cc:460] Webserver started at http://127.9.127.195:40799/ using document root <none> and password file <none>
I20260811 10:04:53.357160 24432 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:53.357241 24432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 10:04:53 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:53.376513 24432 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.000s sys 0.001s
I20260811 10:04:53.377772 24449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.377959 24432 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 10:04:53.378129 24432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "303c09e64c6a4a25a701ecdfe75fc5a6"
format_stamp: "Formatted at 2026-08-11 10:04:52 on dist-test-slave-1x4g"
server_key: "29cb23719c9e6529bade22f89bc8ef5f"
server_key_iv: "a687c970a123ca3f6403cc5dc4926472"
server_key_version: "kuduclusterkey@0"
I20260811 10:04:53.378669 24432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:53.394542 24432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:53.397022 24432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:53.397192 24432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:53.397567 24432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:04:53.397977 24432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:04:53.398028 24432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.398063 24432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:04:53.398136 24432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:53.407292 24432 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:37521
I20260811 10:04:53.407920 24432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:04:53.408416 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 24432
I20260811 10:04:53.408396 24574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:37521 every 8 connection(s)
Aug 11 10:04:53 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:53.421834 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:53.408916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46902 (local address 127.9.127.254:33793)
0811 10:04:53.408970 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:53.408972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:53.410402 (+ 1430us) server_negotiation.cc:407] Connection header received
0811 10:04:53.410574 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:53.410575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:53.410589 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:53.410673 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:53.411567 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.412340 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.415317 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.415609 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.415690 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:53.418434 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:53.418436 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:53.418436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:53.418444 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:53.420257 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:53.420666 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:53.420667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:53.420667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:53.420731 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:53.421259 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:53.421260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:53.421261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:53.421400 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:53.421584 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:53.421648 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 10:04:53.421724 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 10:04:53.424422 24578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:53.409896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33793 (local address 127.9.127.195:58055)
0811 10:04:53.412722 (+ 2826us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:53.412770 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:53.413407 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:53.415114 (+ 1707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:53.415118 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:53.415343 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:53.415630 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:53.415638 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.416613 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.416614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:53.417935 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:53.417938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.418529 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.418530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:53.418674 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:53.419187 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:53.419197 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:53.420973 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:53.422929 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:53.422936 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:53.422938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:53.423167 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:53.423390 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:53.423391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:53.423391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:53.423510 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:53.423767 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:53.423773 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:53.423918 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 10:04:53.424037 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 10:04:53.424190 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2779,"thread_start_us":99,"threads_started":1}
I20260811 10:04:53.424851 24579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:53.410316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:58055 (local address 127.9.127.254:33793)
0811 10:04:53.414848 (+ 4532us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:53.414850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:53.414861 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:04:53.414883 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:53.414884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:53.414895 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:53.414976 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:53.415751 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.416498 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.418046 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:53.418351 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:53.418422 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:53.421071 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:53.421072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:53.421072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:53.421078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:53.422832 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:53.423258 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:53.423259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:53.423259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:53.423326 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:53.423586 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:53.423587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:53.423587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:53.423697 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:53.423774 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:53.424641 (+ 867us) server_negotiation.cc:299] Negotiation successful
0811 10:04:53.424725 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4501,"thread_start_us":69,"threads_started":1}
I20260811 10:04:53.425367 24575 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33793
I20260811 10:04:53.425499 24575 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.425685 24575 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
W20260811 10:04:53.426345 24575 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:33793 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 10:04:53.426440 24575 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.426524 24575 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:53.426852 24575 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:53.426926 24575 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
W20260811 10:04:53.427215 24575 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 10:04:53 dist-test-slave-1x4g krb5kdc[22974](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:54.092878 24275 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:54.093040 24275 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:54.093487 24054 ts_manager.cc:194] Registered new tserver with Master: 172a3e1b57e942f08a7abb626cbde245 (127.9.127.193:38591)
I20260811 10:04:54.094548 24054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:37641
I20260811 10:04:54.249047 24428 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:54.249262 24428 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:54.249692 24054 ts_manager.cc:194] Registered new tserver with Master: 95a581fa4a8d4e30a36145bbfc01760a (127.9.127.194:39893)
I20260811 10:04:54.250317 24054 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:35677
Aug 11 10:04:54 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
I20260811 10:04:54.427416 24575 heartbeater.cc:464] Registering TS with master...
I20260811 10:04:54.427559 24575 heartbeater.cc:511] Master 127.9.127.254:33793 requested a full tablet report, sending...
I20260811 10:04:54.427899 24053 ts_manager.cc:194] Registered new tserver with Master: 303c09e64c6a4a25a701ecdfe75fc5a6 (127.9.127.195:37521)
I20260811 10:04:54.428340 24053 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:58055
I20260811 10:04:54.436537 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:04:54.446848 24597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.437583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46916 (local address 127.9.127.254:33793)
0811 10:04:54.438647 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:54.438649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:54.438658 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:04:54.438689 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:54.438689 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:54.438700 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:54.438786 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:54.439640 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.440280 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.441380 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.441592 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.441703 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.443389 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:54.443391 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:54.443391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:54.443398 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:54.445321 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:54.445728 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:54.445729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:54.445729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:54.445809 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:54.446025 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:54.446025 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:54.446026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:54.446173 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:54.446270 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:54.446646 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 10:04:54.446726 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1039,"thread_start_us":69,"threads_started":1}
I20260811 10:04:54.449450 24053 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:04:54.451819 24053 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:04:54.481988 24606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.473931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38591 (local address 127.0.0.1:58014)
0811 10:04:54.476985 (+ 3054us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:54.477033 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:54.477110 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:54.477505 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:54.477510 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:54.477513 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:54.477593 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.477595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.478912 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.478913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.480230 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.480233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.481626 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.481627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.481727 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.481759 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 10:04:54.481834 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 10:04:54.481895 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3001,"thread_start_us":85,"threads_started":1}
I20260811 10:04:54.482375 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.474055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58014 (local address 127.9.127.193:38591)
0811 10:04:54.474384 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:54.474390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:54.477122 (+ 2732us) server_negotiation.cc:407] Connection header received
0811 10:04:54.477230 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:54.477232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:54.477251 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:54.477337 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:54.477687 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.478807 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.480351 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.481418 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.481485 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.481560 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:54.482165 (+ 605us) server_negotiation.cc:299] Negotiation successful
0811 10:04:54.482233 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":74,"threads_started":1}
I20260811 10:04:54.483542 24201 tablet_service.cc:1467] Processing CreateTablet for tablet d02b84d19adc46daae31971525c67c52 (DEFAULT_TABLE table=test-table [id=966f27de65e14b24b4f88c47695a08b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:04:54.484035 24201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d02b84d19adc46daae31971525c67c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:54.484851 24604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.473933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:37521 (local address 127.0.0.1:41238)
0811 10:04:54.477278 (+ 3345us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:54.477286 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:54.477327 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:54.479478 (+ 2151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:54.479478 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:54.479481 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:54.479521 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.479523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.481935 (+ 2412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.481936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.483315 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.483318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.484593 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.484594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.484657 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.484661 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:04:54.484714 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 10:04:54.484750 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3319,"thread_start_us":95,"threads_started":1}
I20260811 10:04:54.485069 24605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.473943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39893 (local address 127.0.0.1:57610)
0811 10:04:54.477422 (+ 3479us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:54.477431 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:54.477472 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:54.477961 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:54.477962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:54.477964 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:54.478005 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.478006 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.480723 (+ 2717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.480724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.481836 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.481840 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.484837 (+ 2997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.484837 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.484898 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.484902 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:04:54.484952 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:04:54.485000 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3454,"thread_start_us":122,"threads_started":1}
I20260811 10:04:54.485217 24608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.474200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41238 (local address 127.9.127.195:37521)
0811 10:04:54.474503 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:54.474506 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:54.477752 (+ 3246us) server_negotiation.cc:407] Connection header received
0811 10:04:54.477791 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:54.477793 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:54.477807 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:54.477872 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:54.479601 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.480604 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.483415 (+ 2811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.484426 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.484501 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.484556 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:54.485039 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 10:04:54.485083 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":76,"threads_started":1}
I20260811 10:04:54.485347 24610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.474205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57610 (local address 127.9.127.194:39893)
0811 10:04:54.474428 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:54.474433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:54.477527 (+ 3094us) server_negotiation.cc:407] Connection header received
0811 10:04:54.477568 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:54.477571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:54.477588 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:54.477652 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:54.478084 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.479386 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.483822 (+ 4436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.484659 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.484705 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.484753 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:54.485226 (+ 473us) server_negotiation.cc:299] Negotiation successful
0811 10:04:54.485272 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":68,"threads_started":1}
I20260811 10:04:54.485837 24504 tablet_service.cc:1467] Processing CreateTablet for tablet d02b84d19adc46daae31971525c67c52 (DEFAULT_TABLE table=test-table [id=966f27de65e14b24b4f88c47695a08b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:04:54.485905 24347 tablet_service.cc:1467] Processing CreateTablet for tablet d02b84d19adc46daae31971525c67c52 (DEFAULT_TABLE table=test-table [id=966f27de65e14b24b4f88c47695a08b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:04:54.486212 24347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d02b84d19adc46daae31971525c67c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:54.486279 24504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d02b84d19adc46daae31971525c67c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:54.490607 24611 tablet_bootstrap.cc:492] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Bootstrap starting.
I20260811 10:04:54.491070 24614 tablet_bootstrap.cc:492] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Bootstrap starting.
I20260811 10:04:54.491281 24611 tablet_bootstrap.cc:654] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:54.492014 24611 log.cc:824] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:54.492199 24614 tablet_bootstrap.cc:654] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:54.492921 24612 tablet_bootstrap.cc:492] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245: Bootstrap starting.
I20260811 10:04:54.492959 24614 log.cc:824] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:54.493197 24611 tablet_bootstrap.cc:492] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: No bootstrap required, opened a new log
I20260811 10:04:54.493278 24611 ts_tablet_manager.cc:1397] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:04:54.493938 24614 tablet_bootstrap.cc:492] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: No bootstrap required, opened a new log
I20260811 10:04:54.494014 24614 ts_tablet_manager.cc:1397] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 10:04:54.494058 24612 tablet_bootstrap.cc:654] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:54.494557 24612 log.cc:824] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:54.495399 24612 tablet_bootstrap.cc:492] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245: No bootstrap required, opened a new log
I20260811 10:04:54.495464 24612 ts_tablet_manager.cc:1397] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:04:54.496719 24611 raft_consensus.cc:348] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.497005 24611 raft_consensus.cc:374] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:54.497068 24611 raft_consensus.cc:729] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95a581fa4a8d4e30a36145bbfc01760a, State: Initialized, Role: FOLLOWER
I20260811 10:04:54.497196 24611 consensus_queue.cc:260] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.497532 24611 ts_tablet_manager.cc:1428] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 10:04:54.497390 24614 raft_consensus.cc:348] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.497594 24614 raft_consensus.cc:374] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:54.497732 24614 raft_consensus.cc:729] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 303c09e64c6a4a25a701ecdfe75fc5a6, State: Initialized, Role: FOLLOWER
I20260811 10:04:54.498036 24614 consensus_queue.cc:260] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.498399 24614 ts_tablet_manager.cc:1428] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260811 10:04:54.498584 24575 heartbeater.cc:503] Master 127.9.127.254:33793 was elected leader, sending a full tablet report...
I20260811 10:04:54.498970 24612 raft_consensus.cc:348] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.499128 24612 raft_consensus.cc:374] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:54.499172 24612 raft_consensus.cc:729] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 172a3e1b57e942f08a7abb626cbde245, State: Initialized, Role: FOLLOWER
I20260811 10:04:54.499277 24612 consensus_queue.cc:260] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.499557 24612 ts_tablet_manager.cc:1428] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 10:04:54.499706 24275 heartbeater.cc:503] Master 127.9.127.254:33793 was elected leader, sending a full tablet report...
I20260811 10:04:54.499953 24428 heartbeater.cc:503] Master 127.9.127.254:33793 was elected leader, sending a full tablet report...
W20260811 10:04:54.562244 24276 tablet.cc:2369] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:04:54.660281 24576 tablet.cc:2369] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 10:04:54 dist-test-slave-1x4g krb5kdc[22974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442693, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for HTTP/127.9.127.212@KRBTEST.COM
W20260811 10:04:54.735370 24429 tablet.cc:2369] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:04:54.757915 24621 raft_consensus.cc:482] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:04:54.758083 24621 raft_consensus.cc:504] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.758531 24621 leader_election.cc:288] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95a581fa4a8d4e30a36145bbfc01760a (127.9.127.194:39893), 303c09e64c6a4a25a701ecdfe75fc5a6 (127.9.127.195:37521)
I20260811 10:04:54.763321 24608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.759019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:58487 (local address 127.9.127.195:37521)
0811 10:04:54.759121 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:54.759123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:54.759203 (+ 80us) server_negotiation.cc:407] Connection header received
0811 10:04:54.759293 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:54.759294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:54.759304 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:54.759331 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:54.759531 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.760339 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.762096 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.762753 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.762832 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.762841 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:54.763198 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 10:04:54.763245 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 10:04:54.763620 24610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.758946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:45339 (local address 127.9.127.194:39893)
0811 10:04:54.759066 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:54.759068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:54.759079 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:04:54.759153 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:54.759154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:54.759163 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:54.759219 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:04:54.759726 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.760441 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.762157 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.762753 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.762805 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.762816 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:54.763498 (+ 682us) server_negotiation.cc:299] Negotiation successful
0811 10:04:54.763551 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 10:04:54.763904 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.758730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:37521 (local address 127.9.127.193:58487)
0811 10:04:54.759155 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:54.759163 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:54.759224 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:54.759391 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:54.759392 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:54.759393 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:54.759463 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.759465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.760471 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.760471 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.761971 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.761974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.762987 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.762989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.763099 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.763103 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:04:54.763650 (+ 547us) client_negotiation.cc:240] Negotiation successful
0811 10:04:54.763705 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":94,"threads_started":1}
I20260811 10:04:54.764303 24526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02b84d19adc46daae31971525c67c52" candidate_uuid: "172a3e1b57e942f08a7abb626cbde245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" is_pre_election: true
I20260811 10:04:54.764442 24526 raft_consensus.cc:2454] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 172a3e1b57e942f08a7abb626cbde245 in term 0.
I20260811 10:04:54.764662 24151 leader_election.cc:302] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 172a3e1b57e942f08a7abb626cbde245, 303c09e64c6a4a25a701ecdfe75fc5a6; no voters:
I20260811 10:04:54.764796 24621 raft_consensus.cc:2781] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:04:54.764851 24621 raft_consensus.cc:482] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:04:54.764879 24621 raft_consensus.cc:3037] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:54.765136 24625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.758696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39893 (local address 127.9.127.193:45339)
0811 10:04:54.758992 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:54.759016 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:54.759071 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:54.759314 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:54.759315 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:54.759317 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:04:54.759626 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.759629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.760553 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.760554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.762046 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:54.762050 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.763023 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.763024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:54.763169 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.763174 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:04:54.764976 (+ 1802us) client_negotiation.cc:240] Negotiation successful
0811 10:04:54.765027 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":110,"threads_started":1}
I20260811 10:04:54.766287 24621 raft_consensus.cc:504] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.766433 24621 leader_election.cc:288] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [CANDIDATE]: Term 1 election: Requested vote from peers 95a581fa4a8d4e30a36145bbfc01760a (127.9.127.194:39893), 303c09e64c6a4a25a701ecdfe75fc5a6 (127.9.127.195:37521)
I20260811 10:04:54.766659 24526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02b84d19adc46daae31971525c67c52" candidate_uuid: "172a3e1b57e942f08a7abb626cbde245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6"
I20260811 10:04:54.766736 24526 raft_consensus.cc:3037] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:54.767562 24374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02b84d19adc46daae31971525c67c52" candidate_uuid: "172a3e1b57e942f08a7abb626cbde245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a581fa4a8d4e30a36145bbfc01760a" is_pre_election: true
I20260811 10:04:54.767710 24374 raft_consensus.cc:2454] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 172a3e1b57e942f08a7abb626cbde245 in term 0.
I20260811 10:04:54.767899 24526 raft_consensus.cc:2454] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 172a3e1b57e942f08a7abb626cbde245 in term 1.
I20260811 10:04:54.767868 24373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02b84d19adc46daae31971525c67c52" candidate_uuid: "172a3e1b57e942f08a7abb626cbde245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95a581fa4a8d4e30a36145bbfc01760a"
I20260811 10:04:54.767946 24373 raft_consensus.cc:3037] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:54.768113 24151 leader_election.cc:302] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 172a3e1b57e942f08a7abb626cbde245, 303c09e64c6a4a25a701ecdfe75fc5a6; no voters:
I20260811 10:04:54.768226 24621 raft_consensus.cc:2781] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:04:54.768405 24621 raft_consensus.cc:686] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [term 1 LEADER]: Becoming Leader. State: Replica: 172a3e1b57e942f08a7abb626cbde245, State: Running, Role: LEADER
I20260811 10:04:54.768502 24621 consensus_queue.cc:237] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } }
I20260811 10:04:54.769068 24373 raft_consensus.cc:2454] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 172a3e1b57e942f08a7abb626cbde245 in term 1.
I20260811 10:04:54.769461 24053 catalog_manager.cc:5495] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 reported cstate change: term changed from 0 to 1, leader changed from <none> to 172a3e1b57e942f08a7abb626cbde245 (127.9.127.193). New cstate: current_term: 1 leader_uuid: "172a3e1b57e942f08a7abb626cbde245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "172a3e1b57e942f08a7abb626cbde245" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 38591 } health_report { overall_health: HEALTHY } } }
I20260811 10:04:54.827977 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.824685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58030 (local address 127.9.127.193:38591)
0811 10:04:54.824775 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:54.824778 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:54.824810 (+ 32us) server_negotiation.cc:407] Connection header received
0811 10:04:54.824856 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:54.824857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:54.824879 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:54.824974 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:04:54.825167 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.825765 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.826716 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:54.827034 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:54.827120 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:54.827364 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:04:54.827513 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:04:54.827618 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:54.827868 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 10:04:54.827896 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 10:04:54.835037 24526 raft_consensus.cc:1261] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 1 FOLLOWER]: Refusing update from remote peer 172a3e1b57e942f08a7abb626cbde245: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:04:54.835536 24373 raft_consensus.cc:1261] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 1 FOLLOWER]: Refusing update from remote peer 172a3e1b57e942f08a7abb626cbde245: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:04:54.836050 24621 consensus_queue.cc:1035] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "303c09e64c6a4a25a701ecdfe75fc5a6" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 37521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:04:54.836257 24626 consensus_queue.cc:1035] T d02b84d19adc46daae31971525c67c52 P 172a3e1b57e942f08a7abb626cbde245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95a581fa4a8d4e30a36145bbfc01760a" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:04:54.848626 24629 mvcc.cc:205] Tried to move back new op lower bound from 7317269278023041024 to 7317269277772333056. Current Snapshot: MvccSnapshot[applied={T|T < 7317269278023041024 or (T in {7317269278023041024})}]
I20260811 10:04:54.849268 24633 mvcc.cc:205] Tried to move back new op lower bound from 7317269278023041024 to 7317269277772333056. Current Snapshot: MvccSnapshot[applied={T|T < 7317269278023041024}]
I20260811 10:04:54.849404 24630 mvcc.cc:205] Tried to move back new op lower bound from 7317269278023041024 to 7317269277772333056. Current Snapshot: MvccSnapshot[applied={T|T < 7317269278023041024}]
I20260811 10:04:54.849677 24053 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:04:54.849774 24053 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:04:54.850647 24053 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6317b7be1f734753862ffdcedb15ce26: Sending DeleteTablet for 3 replicas of tablet d02b84d19adc46daae31971525c67c52
I20260811 10:04:54.851022 24504 tablet_service.cc:1514] Processing DeleteTablet for tablet d02b84d19adc46daae31971525c67c52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:04:54 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:41238
I20260811 10:04:54.851287 24201 tablet_service.cc:1514] Processing DeleteTablet for tablet d02b84d19adc46daae31971525c67c52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:04:54 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:58014
I20260811 10:04:54.851320 24347 tablet_service.cc:1514] Processing DeleteTablet for tablet d02b84d19adc46daae31971525c67c52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:04:54 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:57610
I20260811 10:04:54.851650 24640 tablet_replica.cc:330] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: stopping tablet replica
I20260811 10:04:54.851794 24640 raft_consensus.cc:2229] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:04:54.851898 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 24095
I20260811 10:04:54.851975 24640 raft_consensus.cc:2258] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:04:54.855382 24640 ts_tablet_manager.cc:1905] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:04:54.857237 24640 ts_tablet_manager.cc:1918] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:04:54.857378 24640 log.cc:1196] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/d02b84d19adc46daae31971525c67c52
I20260811 10:04:54.857911 24640 ts_tablet_manager.cc:1939] T d02b84d19adc46daae31971525c67c52 P 303c09e64c6a4a25a701ecdfe75fc5a6: Deleting consensus metadata
I20260811 10:04:54.858242 24642 tablet_replica.cc:330] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: stopping tablet replica
I20260811 10:04:54.858479 24038 catalog_manager.cc:4841] TS 303c09e64c6a4a25a701ecdfe75fc5a6 (127.9.127.195:37521): tablet d02b84d19adc46daae31971525c67c52 (table test-table [id=966f27de65e14b24b4f88c47695a08b1]) successfully deleted
I20260811 10:04:54.858771 24642 raft_consensus.cc:2229] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:04:54.858912 24642 raft_consensus.cc:2258] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:04:54.863397 24642 ts_tablet_manager.cc:1905] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:04:54.865160 24642 ts_tablet_manager.cc:1918] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:04:54.865242 24642 log.cc:1196] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/d02b84d19adc46daae31971525c67c52
I20260811 10:04:54.865526 24642 ts_tablet_manager.cc:1939] T d02b84d19adc46daae31971525c67c52 P 95a581fa4a8d4e30a36145bbfc01760a: Deleting consensus metadata
I20260811 10:04:54.866128 24037 catalog_manager.cc:4841] TS 95a581fa4a8d4e30a36145bbfc01760a (127.9.127.194:39893): tablet d02b84d19adc46daae31971525c67c52 (table test-table [id=966f27de65e14b24b4f88c47695a08b1]) successfully deleted
W20260811 10:04:54.866469 24040 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:38591 (error 108)
I20260811 10:04:54.867094 24605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:54.866977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:38591 (local address 127.0.0.1:58036)
0811 10:04:54.867027 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:54.867064 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:38591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 10:04:54.867228 24040 catalog_manager.cc:4584] TS 172a3e1b57e942f08a7abb626cbde245 (127.9.127.193:38591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d02b84d19adc46daae31971525c67c52: Network error: Client connection negotiation failed: client connection to 127.9.127.193:38591: connect: Connection refused (error 111)
I20260811 10:04:54.867674 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 24277
I20260811 10:04:54.876330 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 24432
I20260811 10:04:54.883401 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 24019
I20260811 10:04:54.892740 9727 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 10:04:55.238214 9727 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 10:04:55.238312 9727 mini_ranger.cc:66] Stopping Ranger...
I20260811 10:04:55.583169 9727 mini_ranger.cc:68] Stopped Ranger
2026-08-11 10:04:55.583 UTC [23007] LOG: received smart shutdown request
2026-08-11 10:04:55.588 UTC [23007] LOG: background worker "logical replication launcher" (PID 23017) exited with exit code 1
2026-08-11 10:04:55.588 UTC [23012] LOG: shutting down
2026-08-11 10:04:55.750 UTC [23007] LOG: database system is shut down
2026-08-11T10:04:55Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49078 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:04:55 dist-test-slave-1x4g krb5kdc[24653](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:04:55 dist-test-slave-1x4g krb5kdc[24653](info): set up 2 sockets
Aug 11 10:04:55 dist-test-slave-1x4g krb5kdc[24653](info): commencing operation
krb5kdc: starting...
W20260811 10:04:56.958637 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:04:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:04:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:04:57.083667 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:43807
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:36477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:43807,127.9.127.253:36319,127.9.127.252:41803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:04:57.166792 24666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:57.167037 24666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:57.167074 24666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:57.168175 24666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:04:57.168242 24666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:57.168264 24666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:57.168286 24666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:04:57.168313 24666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:04:57.169900 24666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:36477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:43807,127.9.127.253:36319,127.9.127.252:41803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:43807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:57.170181 24666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:57.170406 24666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:57.175379 24671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:57.175384 24672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:57.175384 24674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:57.175401 24666 server_base.cc:1034] running on GCE node
I20260811 10:04:57.175843 24666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:57.176210 24666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:57.177363 24666 hybrid_clock.cc:648] HybridClock initialized: now 1786442697177339 us; error 43 us; skew 500 ppm
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:57.179852 24666 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:04:57.180286 24666 webserver.cc:460] Webserver started at http://127.9.127.254:38023/ using document root <none> and password file <none>
I20260811 10:04:57.180542 24666 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:57.180614 24666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:57.180763 24666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:04:57.181905 24666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "387b1b1be94a42b8b0f61947e71115f1"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "ebcfcc97a88e7a55cda4a0919cfb930c"
server_key_iv: "5704a41a50cba9f97416a92533d8cf2b"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.182291 24666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "387b1b1be94a42b8b0f61947e71115f1"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "ebcfcc97a88e7a55cda4a0919cfb930c"
server_key_iv: "5704a41a50cba9f97416a92533d8cf2b"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.183641 24666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:04:57.184442 24681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:57.184617 24666 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:04:57.184729 24666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "387b1b1be94a42b8b0f61947e71115f1"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "ebcfcc97a88e7a55cda4a0919cfb930c"
server_key_iv: "5704a41a50cba9f97416a92533d8cf2b"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.184828 24666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:57.200855 24666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:57.202730 24666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:57.202895 24666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:57.207089 24666 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:43807
I20260811 10:04:57.207119 24736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:43807 every 8 connection(s)
I20260811 10:04:57.207499 24666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:04:57.208411 24737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:57.209236 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 24666
I20260811 10:04:57.209362 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:04:57.209589 9727 external_mini_cluster.cc:1428] Setting key c1e5e6bd82a4507fe78e8abbb6d1b926
I20260811 10:04:57.210822 24737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.127.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.253@KRBTEST.COM" created.
I20260811 10:04:57.221149 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.211713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43807 (local address 127.0.0.1:56706)
0811 10:04:57.211898 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.211939 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.212430 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.212734 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.212737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.213048 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.213203 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.213207 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.214306 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.214307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.214973 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.214975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.215490 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.215491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.215561 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.216105 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.216114 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.217902 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.219611 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.219618 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.219620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.219812 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.220080 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.220081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.220081 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.220168 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.220530 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.220536 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.220600 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.220702 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.220961 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":118,"thread_start_us":89,"threads_started":1}
I20260811 10:04:57.221153 24742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.211739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56706 (local address 127.9.127.254:43807)
0811 10:04:57.211925 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.211935 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.212043 (+ 108us) server_negotiation.cc:407] Connection header received
0811 10:04:57.212597 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.212599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.212615 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.212728 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.213307 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.214211 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.215075 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.215385 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.215512 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.217994 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.218003 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.218003 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.218010 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.219511 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.219911 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.219914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.219914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.220001 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.220235 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.220236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.220236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.220450 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.220540 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.220742 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.220894 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":98,"threads_started":1}
I20260811 10:04:57.221845 24737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:04:57.222220 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.222107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39570)
0811 10:04:57.222158 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.222201 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 10:04:57.222353 24684 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
I20260811 10:04:57.222759 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.222667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39586)
0811 10:04:57.222714 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.222738 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 10:04:57.222862 24737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:36319: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab.
Entry for principal kudu/127.9.127.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab.
I20260811 10:04:57.236059 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.253:36319
--webserver_interface=127.9.127.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab
--principal=kudu/127.9.127.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:36477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:43807,127.9.127.253:36319,127.9.127.252:41803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:04:57.272096 24737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } attempt: 1
I20260811 10:04:57.272643 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.272463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39590)
0811 10:04:57.272539 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.272597 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 10:04:57.273135 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.272983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39604)
0811 10:04:57.273054 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.273101 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 10:04:57.273259 24737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:36319: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
W20260811 10:04:57.319017 24745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:57.319221 24745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:57.319243 24745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:57.320407 24745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:04:57.320451 24745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:57.320469 24745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:57.320524 24745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:04:57.320554 24745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:04:57.322211 24745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:36477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:43807,127.9.127.253:36319,127.9.127.252:41803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab
--principal=kudu/127.9.127.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.253:36319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.127.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:57.322464 24745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:57.322707 24745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:57.327636 24750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:57.327656 24751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:57.327683 24753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:57.327751 24745 server_base.cc:1034] running on GCE node
I20260811 10:04:57.328207 24745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:57.328487 24745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:57.329653 24745 hybrid_clock.cc:648] HybridClock initialized: now 1786442697329647 us; error 35 us; skew 500 ppm
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:57.332118 24745 init.cc:377] Logged in from keytab as kudu/127.9.127.253@KRBTEST.COM (short username kudu)
I20260811 10:04:57.332554 24745 webserver.cc:460] Webserver started at http://127.9.127.253:36743/ using document root <none> and password file <none>
I20260811 10:04:57.332826 24745 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:57.332898 24745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:57.333055 24745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:04:57.334072 24745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/data/instance:
uuid: "d9872153c8124d419619da5fcc34bc16"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "90600fc1a909848a1ec52e4b62fdfcf3"
server_key_iv: "876c699c31096ca6feaeda602983918d"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.334455 24745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/wal/instance:
uuid: "d9872153c8124d419619da5fcc34bc16"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "90600fc1a909848a1ec52e4b62fdfcf3"
server_key_iv: "876c699c31096ca6feaeda602983918d"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.335813 24745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:04:57.336535 24761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:57.336732 24745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:04:57.336860 24745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/wal
uuid: "d9872153c8124d419619da5fcc34bc16"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "90600fc1a909848a1ec52e4b62fdfcf3"
server_key_iv: "876c699c31096ca6feaeda602983918d"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.336936 24745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:57.341440 24737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } attempt: 2
I20260811 10:04:57.341857 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.341716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39606)
0811 10:04:57.341777 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.341820 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 10:04:57.342226 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.342127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39608)
0811 10:04:57.342173 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.342201 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 10:04:57.342348 24737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:36319: Network error: Client connection negotiation failed: client connection to 127.9.127.253:36319: connect: Connection refused (error 111)
I20260811 10:04:57.345602 24745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:57.347347 24745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:57.347455 24745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:57.351634 24745 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.253:36319
I20260811 10:04:57.351682 24819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.253:36319 every 8 connection(s)
I20260811 10:04:57.352015 24745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
I20260811 10:04:57.353049 24820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:57.354620 24820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:57.361398 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 24745
I20260811 10:04:57.361528 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-1/wal/instance
I20260811 10:04:57.361755 9727 external_mini_cluster.cc:1428] Setting key ba4a25eb8323aea034ef046148d7d6d9
I20260811 10:04:57.363154 24742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.355331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56720 (local address 127.9.127.254:43807)
0811 10:04:57.355411 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.355414 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.355590 (+ 176us) server_negotiation.cc:407] Connection header received
0811 10:04:57.356049 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.356050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.356060 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.356115 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.356695 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.357228 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.358152 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.358342 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.358393 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.360353 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.360355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.360355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.360362 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.361802 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.362205 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.362206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.362207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.362271 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.362522 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.362523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.362523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.362642 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.362715 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.362977 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.363064 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 10:04:57.363353 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.355284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43807 (local address 127.0.0.1:56720)
0811 10:04:57.355468 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.355505 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.355951 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.356175 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.356178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.356414 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.356608 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.356612 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.357311 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.357312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.358079 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.358081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.358414 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.358414 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.358516 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.358933 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.358941 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.360269 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.361882 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.361890 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.361892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.362127 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.362337 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.362338 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.362338 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.362444 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.362707 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.362714 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.362849 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.362956 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.363119 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":97,"threads_started":1}
I20260811 10:04:57.364001 24820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
I20260811 10:04:57.371536 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.364267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39612)
0811 10:04:57.364318 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.364329 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.364370 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.364631 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.364632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.364809 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.364880 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.364883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.365688 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.365689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.366226 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.366228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.366892 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.366893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.366947 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.367378 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.367384 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.368509 (+ 1125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.370541 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.370542 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.370542 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.370705 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.370929 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.370929 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.370930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.370981 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.371324 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.371325 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.371359 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.371406 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.371474 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 10:04:57.371697 24824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.364366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39612 (local address 127.9.127.253:36319)
0811 10:04:57.364501 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.364504 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.364518 (+ 14us) server_negotiation.cc:407] Connection header received
0811 10:04:57.364533 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.364534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.364543 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.364596 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.364973 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.365603 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.366329 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.366812 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.366891 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.368605 (+ 1714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.368614 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.368614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.368622 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.370448 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.370790 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.370794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.370794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.370855 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.371045 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.371046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.371046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.371241 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.371339 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.371446 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.371551 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":108,"thread_start_us":84,"threads_started":1}
WARNING: no policy specified for kudu/127.9.127.252@KRBTEST.COM; defaulting to no policy
I20260811 10:04:57.372318 24820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:04:57.372674 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.372552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40910)
0811 10:04:57.372606 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.372656 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 10:04:57.372865 24765 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
I20260811 10:04:57.373379 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.373292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40922)
0811 10:04:57.373336 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.373362 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 10:04:57.373566 24820 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41803: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab.
Entry for principal kudu/127.9.127.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab.
I20260811 10:04:57.391021 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.252:41803
--webserver_interface=127.9.127.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab
--principal=kudu/127.9.127.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:36477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:43807,127.9.127.253:36319,127.9.127.252:41803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:04:57.422905 24820 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } attempt: 1
I20260811 10:04:57.423457 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.423312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40924)
0811 10:04:57.423385 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.423428 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 10:04:57.423827 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.423736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40932)
0811 10:04:57.423780 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.423803 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 10:04:57.423931 24820 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41803: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
I20260811 10:04:57.433511 24737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } attempt: 3
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
I20260811 10:04:57.440848 24824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.433973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39628 (local address 127.9.127.253:36319)
0811 10:04:57.434058 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.434060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.434071 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:04:57.434116 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.434117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.434127 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.434191 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.434523 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.435067 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.435833 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.436056 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.436140 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.438150 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.438152 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.438153 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.438160 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.439654 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.440003 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.440004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.440005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.440062 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.440262 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.440263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.440263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.440385 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.440456 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.440665 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.440738 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 10:04:57.440858 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.433879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39628)
0811 10:04:57.433936 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.433948 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.434016 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.434198 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.434200 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.434370 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.434436 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.434438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.435164 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.435165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.435744 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.435746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.436139 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.436140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.436260 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.436766 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.436810 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.438051 (+ 1241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.439741 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.439742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.439743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.439928 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.440135 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.440136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.440136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.440204 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.440466 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.440467 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.440551 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.440627 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.440733 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 10:04:57.441239 24737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:04:57.441601 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.441486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40946)
0811 10:04:57.441537 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.441563 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 10:04:57.442014 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.441951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40954)
0811 10:04:57.441978 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.442001 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 10:04:57.442116 24737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41803: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
I20260811 10:04:57.473250 24737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } attempt: 1
I20260811 10:04:57.473727 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.473590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40956)
0811 10:04:57.473653 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.473696 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 10:04:57.474090 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.473983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40958)
0811 10:04:57.474032 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.474061 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 10:04:57.474187 24737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41803: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
W20260811 10:04:57.479394 24827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:04:57.479588 24827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:04:57.479614 24827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:04:57.480846 24827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:04:57.480896 24827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:04:57.480932 24827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:04:57.480964 24827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:04:57.480989 24827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:04:57.482533 24827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:36477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:43807,127.9.127.253:36319,127.9.127.252:41803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab
--principal=kudu/127.9.127.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.252:41803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.127.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:04:57.482793 24827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:04:57.483038 24827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:04:57.488070 24835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:57.488050 24832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:04:57.488050 24833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:04:57.488476 24827 server_base.cc:1034] running on GCE node
I20260811 10:04:57.488752 24827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:04:57.489076 24827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:04:57.490248 24827 hybrid_clock.cc:648] HybridClock initialized: now 1786442697490239 us; error 34 us; skew 500 ppm
I20260811 10:04:57.492098 24820 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } attempt: 2
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:04:57.492508 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.492361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40970)
0811 10:04:57.492430 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.492470 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 10:04:57.492818 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.492717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40972)
0811 10:04:57.492744 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.492794 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260811 10:04:57.492916 24820 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41803: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41803: connect: Connection refused (error 111)
I20260811 10:04:57.492954 24827 init.cc:377] Logged in from keytab as kudu/127.9.127.252@KRBTEST.COM (short username kudu)
I20260811 10:04:57.493366 24827 webserver.cc:460] Webserver started at http://127.9.127.252:44253/ using document root <none> and password file <none>
I20260811 10:04:57.493579 24827 fs_manager.cc:359] Metadata directory not provided
I20260811 10:04:57.493623 24827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:04:57.493716 24827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:04:57.494724 24827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/data/instance:
uuid: "ab4beb9f18f2405681359dc05a54fe8f"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "e8e4df4049367f21fd8f433d56ba9f21"
server_key_iv: "85c873816a29c74cb86e96bda8eafccd"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.495030 24827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/wal/instance:
uuid: "ab4beb9f18f2405681359dc05a54fe8f"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "e8e4df4049367f21fd8f433d56ba9f21"
server_key_iv: "85c873816a29c74cb86e96bda8eafccd"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.496368 24827 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:04:57.497116 24842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:04:57.497273 24827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:04:57.497364 24827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/wal
uuid: "ab4beb9f18f2405681359dc05a54fe8f"
format_stamp: "Formatted at 2026-08-11 10:04:57 on dist-test-slave-1x4g"
server_key: "e8e4df4049367f21fd8f433d56ba9f21"
server_key_iv: "85c873816a29c74cb86e96bda8eafccd"
server_key_version: "encryptionkey@0"
I20260811 10:04:57.497421 24827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:04:57.515561 24827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:04:57.518040 24827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:04:57.518180 24827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:04:57.522644 24827 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.252:41803
I20260811 10:04:57.522708 24899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.252:41803 every 8 connection(s)
I20260811 10:04:57.523103 24827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
I20260811 10:04:57.524011 24900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:04:57.525699 24900 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:04:57.526674 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 24827
I20260811 10:04:57.526814 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786442543469380-9727-0/minicluster-data/master-2/wal/instance
I20260811 10:04:57.527012 9727 external_mini_cluster.cc:1428] Setting key c2cef56a631c550bd7a569177c90b50b
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:04:57.536168 24742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.526477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56736 (local address 127.9.127.254:43807)
0811 10:04:57.526545 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.526548 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.526744 (+ 196us) server_negotiation.cc:407] Connection header received
0811 10:04:57.527573 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.527574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.527590 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.527669 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.528414 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.529075 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.530325 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.530637 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.530702 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.533161 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.533162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.533163 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.533170 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.534691 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.535133 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.535134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.535135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.535195 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.535459 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.535461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.535461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.535592 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.535689 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.535979 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.536074 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:04:57.536355 24902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.526402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43807 (local address 127.0.0.1:56736)
0811 10:04:57.526618 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.526656 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.527389 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.527774 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.527777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.528164 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.528315 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.528320 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.529169 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.529171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.530239 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.530242 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.530724 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.530725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.530873 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.531390 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.531400 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.533070 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.534776 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.534784 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.534786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.535049 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.535272 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.535273 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.535273 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.535387 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.535695 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.535702 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.535838 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.535944 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.536103 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":113,"thread_start_us":124,"threads_started":1}
I20260811 10:04:57.537106 24900 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:04:57.537685 24904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.527463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40976 (local address 127.9.127.252:41803)
0811 10:04:57.527686 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.527690 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.527853 (+ 163us) server_negotiation.cc:407] Connection header received
0811 10:04:57.527878 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.527880 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.527907 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.528007 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.528610 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.529795 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.530628 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.531047 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.531128 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.534071 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.534080 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.534080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.534088 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.535733 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.536170 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.536174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.536174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.536271 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.536524 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.536525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.536526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.536944 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.537109 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.537453 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.537545 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":128,"threads_started":1}
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:04:57.544315 24902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.537383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:36319 (local address 127.0.0.1:39642)
0811 10:04:57.537533 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.537543 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.537594 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.537713 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.537714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.538073 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.538138 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.538140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.538874 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.538875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.539435 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.539438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.539820 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.539821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.539896 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.540320 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.540325 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.541646 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.543269 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.543270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.543271 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.543445 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.543664 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.543665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.543665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.543725 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.543981 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.543981 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.544025 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.544116 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.544213 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260811 10:04:57.544324 24824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.537454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39642 (local address 127.9.127.253:36319)
0811 10:04:57.537504 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.537506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.537585 (+ 79us) server_negotiation.cc:407] Connection header received
0811 10:04:57.537655 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.537655 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.537666 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.537707 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.538237 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.538779 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.539514 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.539745 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.539823 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.541735 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.541736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.541737 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.541743 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.543180 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.543530 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.543531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.543531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.543592 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.543795 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.543796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.543796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.543913 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.543988 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.544155 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.544241 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 10:04:57.544667 24900 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:04:57.546016 24742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.538451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56750 (local address 127.9.127.254:43807)
0811 10:04:57.538487 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.538489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.538540 (+ 51us) server_negotiation.cc:407] Connection header received
0811 10:04:57.538610 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.538612 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.538620 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.538674 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.539147 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.539674 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.540372 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.540600 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.540656 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.543226 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.543227 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.543228 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.543235 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.544927 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.545283 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.545285 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.545285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.545351 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.545588 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.545588 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.545588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.545688 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.545824 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.545896 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.545958 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:04:57.549322 24737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } attempt: 2
I20260811 10:04:57.551898 24902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.544952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:40988)
0811 10:04:57.544982 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.544991 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.545026 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.545129 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.545130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.545290 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.545327 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.545329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.546199 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.546200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.546754 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.546757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.547364 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.547365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.547405 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.547794 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.547799 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.549138 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.550881 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.550882 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.550882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.551045 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.551253 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.551254 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.551254 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.551362 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.551608 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.551608 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.551645 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.551713 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.551809 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
I20260811 10:04:57.552525 24904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.545002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40988 (local address 127.9.127.252:41803)
0811 10:04:57.545038 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.545040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.545047 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:04:57.545067 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.545067 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.545077 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.545118 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.545417 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.546124 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.546957 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.547289 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.547360 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.549224 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.549225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.549226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.549233 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.550779 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.551129 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.551130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.551131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.551184 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.551430 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.551431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.551431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.551541 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.551614 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.551740 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.552476 (+ 736us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":664,"server-negotiator.queue_time_us":22}
I20260811 10:04:57.554217 24900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: Bootstrap starting.
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:04:57.554921 24900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:57.555346 24900 log.cc:824] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:57.556160 24824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.546969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39644 (local address 127.9.127.253:36319)
0811 10:04:57.547002 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.547004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.547011 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:04:57.547032 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.547033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.547040 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.547102 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.547715 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.548385 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.549250 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.549575 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.549818 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.552946 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.552947 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.552948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.552955 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.554705 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.555193 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.555194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.555194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.555247 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.555535 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.555536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.555537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.555684 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.555901 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.555947 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.556052 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 10:04:57.556313 24900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: No bootstrap required, opened a new log
I20260811 10:04:57.557596 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:04:57.558670 24900 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.558835 24900 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:57.558874 24900 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab4beb9f18f2405681359dc05a54fe8f, State: Initialized, Role: FOLLOWER
I20260811 10:04:57.558912 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.549564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:41004)
0811 10:04:57.549617 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.549631 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.549666 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.549959 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.549960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.550123 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.550157 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.550159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.551823 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.551824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.552353 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.552355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.553087 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.553089 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.553149 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.553613 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.553618 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.555055 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.557726 (+ 2671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.557727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.557728 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.557932 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.558153 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.558154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.558154 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.558230 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.558562 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.558563 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.558622 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.558701 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.558811 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 10:04:57.559037 24900 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.559444 24905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.549653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41004 (local address 127.9.127.252:41803)
0811 10:04:57.549826 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.549828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.549835 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:04:57.549856 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.549856 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.549866 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.550215 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.550249 (+ 34us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.551710 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.552437 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.552996 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.553267 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.555140 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.555141 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.555141 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.555148 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.557617 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.558011 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.558013 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.558013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.558073 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.558305 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.558306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.558306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.558482 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.558556 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.559241 (+ 685us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.559322 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":110,"threads_started":1}
I20260811 10:04:57.559495 24900 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:04:57.559834 24913 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.559928 24913 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:04:57.563545 24737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: Bootstrap starting.
I20260811 10:04:57.564327 24737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:57.562065 24827 master_runner.cc:186] Error getting master registration for 127.9.127.254:43807: OK, instance_id { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" instance_seqno: 1786442697205934 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 10:04:57.565194 24827 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 10:04:57.565606 24737 log.cc:824] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: Log is configured to *not* fsync() on all Append() calls
W20260811 10:04:57.566833 24927 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:04:57.566921 24927 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:04:57.567454 24742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.559711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56756 (local address 127.9.127.254:43807)
0811 10:04:57.559752 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.559754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.560117 (+ 363us) server_negotiation.cc:407] Connection header received
0811 10:04:57.560216 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.560218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.560228 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.560259 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.560990 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.561628 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.562523 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.562780 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.562821 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.564260 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.564261 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.564262 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.564268 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.565999 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.566485 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.566486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.566486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.566543 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.566746 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.566747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.566747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.566903 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.567031 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.567250 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.567339 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 10:04:57.567880 24904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.559376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41016 (local address 127.9.127.252:41803)
0811 10:04:57.559413 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.559415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.559650 (+ 235us) server_negotiation.cc:407] Connection header received
0811 10:04:57.559755 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.559756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.559768 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.559818 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.560548 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.561282 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.562240 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.562534 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.562570 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.564232 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.564233 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.564234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.564241 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.566149 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.566562 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.566563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.566563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.566615 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.566814 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.566815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.566815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.567041 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.567102 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.567302 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.567386 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:04:57.567996 24737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: No bootstrap required, opened a new log
I20260811 10:04:57.569849 24737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.569988 24737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:57.570035 24737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387b1b1be94a42b8b0f61947e71115f1, State: Initialized, Role: FOLLOWER
I20260811 10:04:57.570176 24737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.570515 24737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:04:57.570539 24931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.570705 24931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:04:57.570802 24824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.559183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39654 (local address 127.9.127.253:36319)
0811 10:04:57.559400 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.559402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.559551 (+ 149us) server_negotiation.cc:407] Connection header received
0811 10:04:57.559649 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.559649 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.559659 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.559686 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.560446 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.561218 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.565956 (+ 4738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.566266 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.566336 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.567760 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.567762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.567762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.567769 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.569276 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.569668 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.569669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.569670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.569724 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.569934 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.569935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.569936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.570049 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.570647 (+ 598us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.570682 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.570742 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198}
W20260811 10:04:57.572407 24942 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:04:57.572467 24942 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:04:57.573146 24666 master_runner.cc:186] Error getting master registration for 127.9.127.253:36319: OK, instance_id { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" instance_seqno: 1786442697350520 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 10:04:57.575307 24666 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 10:04:57.584048 24820 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } attempt: 3
Aug 11 10:04:57 dist-test-slave-1x4g krb5kdc[24653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442697, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:04:57.591632 24904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.584375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41026 (local address 127.9.127.252:41803)
0811 10:04:57.584421 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:04:57.584423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:04:57.584462 (+ 39us) server_negotiation.cc:407] Connection header received
0811 10:04:57.584484 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:04:57.584485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:04:57.584495 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:04:57.584552 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:04:57.585006 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.585473 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.586260 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.586442 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.586528 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.588994 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:04:57.588996 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:04:57.588996 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:04:57.589004 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:04:57.590464 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.590845 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.590846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.590847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.590908 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:04:57.591121 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:04:57.591122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:04:57.591122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:04:57.591236 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:04:57.591306 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 10:04:57.591466 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 10:04:57.591538 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:04:57.591643 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:04:57.584309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41803 (local address 127.0.0.1:41026)
0811 10:04:57.584357 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 10:04:57.584368 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:04:57.584407 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:04:57.584564 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:04:57.584564 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:04:57.584842 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:04:57.584898 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.584899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.585556 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.585557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.586178 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:04:57.586180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:04:57.586543 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:04:57.586544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:04:57.586606 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:04:57.587121 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:04:57.587126 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:04:57.588906 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:04:57.590598 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.590599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.590599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.590771 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.590978 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:04:57.590978 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:04:57.590979 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:04:57.591038 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:04:57.591311 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:04:57.591312 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:04:57.591356 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 10:04:57.591441 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 10:04:57.591538 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 10:04:57.593088 24820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16: Bootstrap starting.
I20260811 10:04:57.593714 24820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16: Neither blocks nor log segments found. Creating new log.
I20260811 10:04:57.594055 24820 log.cc:824] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16: Log is configured to *not* fsync() on all Append() calls
I20260811 10:04:57.594851 24820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16: No bootstrap required, opened a new log
I20260811 10:04:57.597028 24820 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.597159 24820 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:04:57.597204 24820 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9872153c8124d419619da5fcc34bc16, State: Initialized, Role: FOLLOWER
I20260811 10:04:57.597335 24820 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.597605 24945 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.597738 24945 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:04:57.597674 24820 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 10:04:57.597961 24768 tablet.cc:2369] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:04:57.599902 24957 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:04:57.600018 24957 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:04:57.602370 24745 master_runner.cc:263] No leader master found from master d9872153c8124d419619da5fcc34bc16
I20260811 10:04:57.602417 24745 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 10:04:57.703747 24687 tablet.cc:2369] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:04:57.768860 24849 tablet.cc:2369] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:04:57.781522 24945 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:04:57.781643 24945 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.781862 24945 leader_election.cc:288] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 387b1b1be94a42b8b0f61947e71115f1 (127.9.127.254:43807), ab4beb9f18f2405681359dc05a54fe8f (127.9.127.252:41803)
I20260811 10:04:57.782147 24710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9872153c8124d419619da5fcc34bc16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387b1b1be94a42b8b0f61947e71115f1" is_pre_election: true
I20260811 10:04:57.782191 24870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9872153c8124d419619da5fcc34bc16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab4beb9f18f2405681359dc05a54fe8f" is_pre_election: true
I20260811 10:04:57.782318 24710 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9872153c8124d419619da5fcc34bc16 in term 0.
I20260811 10:04:57.782356 24870 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9872153c8124d419619da5fcc34bc16 in term 0.
I20260811 10:04:57.782588 24766 leader_election.cc:302] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387b1b1be94a42b8b0f61947e71115f1, d9872153c8124d419619da5fcc34bc16; no voters:
I20260811 10:04:57.782727 24945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:04:57.782799 24945 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:04:57.782823 24945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:57.783617 24945 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.783782 24945 leader_election.cc:288] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [CANDIDATE]: Term 1 election: Requested vote from peers 387b1b1be94a42b8b0f61947e71115f1 (127.9.127.254:43807), ab4beb9f18f2405681359dc05a54fe8f (127.9.127.252:41803)
I20260811 10:04:57.783984 24710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9872153c8124d419619da5fcc34bc16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387b1b1be94a42b8b0f61947e71115f1"
I20260811 10:04:57.783968 24870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9872153c8124d419619da5fcc34bc16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab4beb9f18f2405681359dc05a54fe8f"
I20260811 10:04:57.784057 24710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:57.784082 24870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:04:57.784721 24710 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9872153c8124d419619da5fcc34bc16 in term 1.
I20260811 10:04:57.784880 24870 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9872153c8124d419619da5fcc34bc16 in term 1.
I20260811 10:04:57.784940 24766 leader_election.cc:302] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387b1b1be94a42b8b0f61947e71115f1, d9872153c8124d419619da5fcc34bc16; no voters:
I20260811 10:04:57.785051 24945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:04:57.785241 24945 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [term 1 LEADER]: Becoming Leader. State: Replica: d9872153c8124d419619da5fcc34bc16, State: Running, Role: LEADER
I20260811 10:04:57.785341 24945 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } }
I20260811 10:04:57.785777 24959 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9872153c8124d419619da5fcc34bc16. Latest consensus state: current_term: 1 leader_uuid: "d9872153c8124d419619da5fcc34bc16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.785882 24959 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:57.786123 24962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:04:57.786309 24962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:04:57.787734 24710 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [term 1 FOLLOWER]: Refusing update from remote peer d9872153c8124d419619da5fcc34bc16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:04:57.787774 24870 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [term 1 FOLLOWER]: Refusing update from remote peer d9872153c8124d419619da5fcc34bc16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:04:57.788064 24945 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:04:57.788193 24959 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:04:57.789428 24931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9872153c8124d419619da5fcc34bc16. Latest consensus state: current_term: 1 leader_uuid: "d9872153c8124d419619da5fcc34bc16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.789547 24931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:04:57.789608 24913 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9872153c8124d419619da5fcc34bc16. Latest consensus state: current_term: 1 leader_uuid: "d9872153c8124d419619da5fcc34bc16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.789700 24913 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:04:57.790333 24963 mvcc.cc:205] Tried to move back new op lower bound from 7317269290136342528 to 7317269290129379328. Current Snapshot: MvccSnapshot[applied={T|T < 7317269290136342528}]
I20260811 10:04:57.790447 24945 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d9872153c8124d419619da5fcc34bc16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.790462 24959 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d9872153c8124d419619da5fcc34bc16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.790556 24945 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:57.790576 24931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d9872153c8124d419619da5fcc34bc16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.790619 24959 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16 [sys.catalog]: This master's current role is: LEADER
I20260811 10:04:57.790647 24931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:04:57.790850 24913 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d9872153c8124d419619da5fcc34bc16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "387b1b1be94a42b8b0f61947e71115f1" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43807 } } peers { permanent_uuid: "d9872153c8124d419619da5fcc34bc16" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 36319 } } peers { permanent_uuid: "ab4beb9f18f2405681359dc05a54fe8f" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41803 } } }
I20260811 10:04:57.790938 24913 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:04:57.790982 24965 mvcc.cc:205] Tried to move back new op lower bound from 7317269290136342528 to 7317269290129379328. Current Snapshot: MvccSnapshot[applied={T|T < 7317269290136342528}]
I20260811 10:04:57.791116 24964 mvcc.cc:205] Tried to move back new op lower bound from 7317269290136342528 to 7317269290129379328. Current Snapshot: MvccSnapshot[applied={T|T < 7317269290136342528}]
I20260811 10:04:57.791273 24962 catalog_manager.cc:1347] Generated new cluster ID: 3dd2da9cfd5d4b93b6c32b69b69173b7
I20260811 10:04:57.791325 24962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:04:57.814440 24962 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:04:57.815126 24962 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:04:57.828114 24962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9872153c8124d419619da5fcc34bc16: Generated new TSK 0
I20260811 10:04:57.828363 24962 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:04:58.567389 24927 catalog_manager.cc:1259] Loaded cluster ID: 3dd2da9cfd5d4b93b6c32b69b69173b7
I20260811 10:04:58.567463 24927 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: loading cluster ID for follower catalog manager: success
I20260811 10:04:58.568226 24927 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: acquiring CA information for follower catalog manager: success
I20260811 10:04:58.568491 24927 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ab4beb9f18f2405681359dc05a54fe8f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 10:04:58.572875 24942 catalog_manager.cc:1259] Loaded cluster ID: 3dd2da9cfd5d4b93b6c32b69b69173b7
I20260811 10:04:58.572932 24942 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: loading cluster ID for follower catalog manager: success
I20260811 10:04:58.573688 24942 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: acquiring CA information for follower catalog manager: success
I20260811 10:04:58.573931 24942 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 387b1b1be94a42b8b0f61947e71115f1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 10:04:58.878976 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 24666
I20260811 10:04:58.887162 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 24745
I20260811 10:04:58.893939 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 24827
2026-08-11T10:04:58Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3031 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:04:58 dist-test-slave-1x4g krb5kdc[24980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:04:58 dist-test-slave-1x4g krb5kdc[24980](info): set up 2 sockets
Aug 11 10:04:58 dist-test-slave-1x4g krb5kdc[24980](info): commencing operation
krb5kdc: starting...
W20260811 10:04:59.981515 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:05:00 dist-test-slave-1x4g krb5kdc[24980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:05:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:05:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:05:00.104179 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:36119
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:43939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:36119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:00.186510 24994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:00.186744 24994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:00.186780 24994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:00.187891 24994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:05:00.187959 24994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:00.187983 24994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:00.188011 24994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:05:00.188042 24994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:05:00.189514 24994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:43939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:36119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:36119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:00.189788 24994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:00.190011 24994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:00.194943 25000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:00.194965 25002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:00.194995 24994 server_base.cc:1034] running on GCE node
W20260811 10:05:00.194965 24999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:00.195394 24994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:00.195694 24994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:00.196846 24994 hybrid_clock.cc:648] HybridClock initialized: now 1786442700196825 us; error 47 us; skew 500 ppm
Aug 11 10:05:00 dist-test-slave-1x4g krb5kdc[24980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442700, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:00.199404 24994 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:05:00.199851 24994 webserver.cc:460] Webserver started at http://127.9.127.254:44373/ using document root <none> and password file <none>
I20260811 10:05:00.200124 24994 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:00.200196 24994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:00.200345 24994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:00.201516 24994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "01095d946fb24046b58de92c5fb791b5"
format_stamp: "Formatted at 2026-08-11 10:05:00 on dist-test-slave-1x4g"
server_key: "8cd3773755b0175055f244fb7f1d4eeb"
server_key_iv: "f7a751aee693c4e3da86f239972b59c5"
server_key_version: "encryptionkey@0"
I20260811 10:05:00.201890 24994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "01095d946fb24046b58de92c5fb791b5"
format_stamp: "Formatted at 2026-08-11 10:05:00 on dist-test-slave-1x4g"
server_key: "8cd3773755b0175055f244fb7f1d4eeb"
server_key_iv: "f7a751aee693c4e3da86f239972b59c5"
server_key_version: "encryptionkey@0"
I20260811 10:05:00.203327 24994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:05:00.204089 25011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:00.204265 24994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:00.204376 24994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "01095d946fb24046b58de92c5fb791b5"
format_stamp: "Formatted at 2026-08-11 10:05:00 on dist-test-slave-1x4g"
server_key: "8cd3773755b0175055f244fb7f1d4eeb"
server_key_iv: "f7a751aee693c4e3da86f239972b59c5"
server_key_version: "encryptionkey@0"
I20260811 10:05:00.204453 24994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:00.223345 24994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:00.225284 24994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:00.225591 24994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:00.229811 24994 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:36119
I20260811 10:05:00.229840 25070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:36119 every 8 connection(s)
I20260811 10:05:00.230230 24994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:05:00.231197 25071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:00.233531 25071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5: Bootstrap starting.
I20260811 10:05:00.234095 25071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:00.234331 25071 log.cc:824] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:00.235009 25071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5: No bootstrap required, opened a new log
I20260811 10:05:00.236521 25071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01095d946fb24046b58de92c5fb791b5" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36119 } }
I20260811 10:05:00.236701 25071 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:00.236726 25071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01095d946fb24046b58de92c5fb791b5, State: Initialized, Role: FOLLOWER
I20260811 10:05:00.236889 25071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01095d946fb24046b58de92c5fb791b5" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36119 } }
I20260811 10:05:00.236979 25071 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:05:00.237003 25071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:05:00.237035 25071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:00.237514 25071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01095d946fb24046b58de92c5fb791b5" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36119 } }
I20260811 10:05:00.237612 25071 leader_election.cc:302] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01095d946fb24046b58de92c5fb791b5; no voters:
I20260811 10:05:00.237758 25071 leader_election.cc:288] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:05:00.237792 25074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:05:00.237929 25074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [term 1 LEADER]: Becoming Leader. State: Replica: 01095d946fb24046b58de92c5fb791b5, State: Running, Role: LEADER
I20260811 10:05:00.238044 25071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:05:00.238087 25074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01095d946fb24046b58de92c5fb791b5" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36119 } }
I20260811 10:05:00.238626 25075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01095d946fb24046b58de92c5fb791b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01095d946fb24046b58de92c5fb791b5" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36119 } } }
I20260811 10:05:00.238729 25075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:00.238741 25076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01095d946fb24046b58de92c5fb791b5. Latest consensus state: current_term: 1 leader_uuid: "01095d946fb24046b58de92c5fb791b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01095d946fb24046b58de92c5fb791b5" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36119 } } }
I20260811 10:05:00.238795 25076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5 [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:00.238945 25083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:05:00.239499 25083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:05:00.239655 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 24994
I20260811 10:05:00.239764 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:05:00.240012 9727 external_mini_cluster.cc:1428] Setting key a6f95d1d7f9a3d7a7fd86ed1553764c1
I20260811 10:05:00.241611 25083 catalog_manager.cc:1347] Generated new cluster ID: 1ad226204520408c9deef65186f5761d
I20260811 10:05:00.241672 25083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:05:00 dist-test-slave-1x4g krb5kdc[24980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:00.251859 25094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:00.240518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34550 (local address 127.9.127.254:36119)
0811 10:05:00.240944 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:00.240951 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:00.240974 (+ 23us) server_negotiation.cc:407] Connection header received
0811 10:05:00.241120 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:00.241128 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:00.241185 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:00.241341 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:00.242179 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:00.243545 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:00.244563 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:00.245231 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:00.245339 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:00.248103 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:00.248107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:00.248107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:00.248119 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:00.250126 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:00.250547 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:00.250550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:00.250550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:00.250677 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:00.250927 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:00.250928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:00.250928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:00.251215 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:00.251360 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:00.251488 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 10:05:00.251624 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":92,"threads_started":1}
I20260811 10:05:00.252450 25083 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:05:00.252900 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:05:00.253189 25083 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:05:00.257042 25083 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01095d946fb24046b58de92c5fb791b5: Generated new TSK 0
I20260811 10:05:00.257210 25083 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:05:00.307322 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 24994
2026-08-11T10:05:00Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1412 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:05:00 dist-test-slave-1x4g krb5kdc[25100](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:05:00 dist-test-slave-1x4g krb5kdc[25100](info): set up 2 sockets
Aug 11 10:05:00 dist-test-slave-1x4g krb5kdc[25100](info): commencing operation
krb5kdc: starting...
W20260811 10:05:01.403931 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:05:01 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:05:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:05:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:05:01.527851 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:43665
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:43665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:01.610247 25116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:01.610503 25116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:01.610544 25116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:01.611765 25116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:05:01.611837 25116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:01.611863 25116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:01.611893 25116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:05:01.611925 25116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:05:01.613476 25116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:43665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:43665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:01.613770 25116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:01.614012 25116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:01.619000 25122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:01.619022 25123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:01.619000 25125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:01.619274 25116 server_base.cc:1034] running on GCE node
I20260811 10:05:01.619496 25116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:01.619799 25116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:01.620970 25116 hybrid_clock.cc:648] HybridClock initialized: now 1786442701620958 us; error 39 us; skew 500 ppm
Aug 11 10:05:01 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:01.628707 25116 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:05:01.629220 25116 webserver.cc:460] Webserver started at http://127.9.127.254:44301/ using document root <none> and password file <none>
I20260811 10:05:01.629489 25116 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:01.629560 25116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:01.629711 25116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:01.630838 25116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "6398a803c3a24508b8192b2ef7d8e1c0"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "b58c8fe8b2c29214a0900590a7862369"
server_key_iv: "65dae8b19ccd1fe4a54ff793bbb38424"
server_key_version: "encryptionkey@0"
I20260811 10:05:01.631230 25116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "6398a803c3a24508b8192b2ef7d8e1c0"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "b58c8fe8b2c29214a0900590a7862369"
server_key_iv: "65dae8b19ccd1fe4a54ff793bbb38424"
server_key_version: "encryptionkey@0"
I20260811 10:05:01.632611 25116 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:05:01.633483 25134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:01.633656 25116 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:01.633767 25116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6398a803c3a24508b8192b2ef7d8e1c0"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "b58c8fe8b2c29214a0900590a7862369"
server_key_iv: "65dae8b19ccd1fe4a54ff793bbb38424"
server_key_version: "encryptionkey@0"
I20260811 10:05:01.633843 25116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:01.670996 25116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:01.673000 25116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:01.673185 25116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:01.677331 25116 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:43665
I20260811 10:05:01.677366 25190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:43665 every 8 connection(s)
I20260811 10:05:01.677740 25116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:05:01.678813 25191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:01.681308 25191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Bootstrap starting.
I20260811 10:05:01.681919 25191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:01.682238 25191 log.cc:824] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:01.682981 25191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: No bootstrap required, opened a new log
I20260811 10:05:01.683632 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 25116
I20260811 10:05:01.683734 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:05:01.683960 9727 external_mini_cluster.cc:1428] Setting key 9fa6a5c298e8b83e8aba2fba8dac0943
I20260811 10:05:01.685271 25191 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:01.685454 25191 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:01.685493 25191 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6398a803c3a24508b8192b2ef7d8e1c0, State: Initialized, Role: FOLLOWER
I20260811 10:05:01.685660 25191 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:01.685731 25191 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:05:01.685753 25191 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:05:01.685823 25191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:01.687000 25191 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:01.687124 25191 leader_election.cc:302] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6398a803c3a24508b8192b2ef7d8e1c0; no voters:
I20260811 10:05:01.687289 25191 leader_election.cc:288] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:05:01.687352 25197 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:05:01.687518 25191 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:05:01.687568 25197 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 6398a803c3a24508b8192b2ef7d8e1c0, State: Running, Role: LEADER
I20260811 10:05:01.687698 25197 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:01.688127 25198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } } }
I20260811 10:05:01.688138 25199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6398a803c3a24508b8192b2ef7d8e1c0. Latest consensus state: current_term: 1 leader_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } } }
I20260811 10:05:01.688249 25198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:01.688264 25199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:01.688436 25206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:05:01.688994 25206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:05:01.690905 25206 catalog_manager.cc:1347] Generated new cluster ID: 823a54ae68bf40d1b7586ebecce55e45
I20260811 10:05:01.690964 25206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:05:01 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:01.696593 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:01.684546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49558 (local address 127.9.127.254:43665)
0811 10:05:01.684793 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:01.684804 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:01.684842 (+ 38us) server_negotiation.cc:407] Connection header received
0811 10:05:01.685232 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:01.685242 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:01.685319 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:01.685475 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:01.686270 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:01.687761 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:01.688977 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:01.689580 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:01.689687 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:01.692876 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:01.692880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:01.692881 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:01.692893 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:01.694851 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:01.695282 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:01.695285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:01.695286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:01.695412 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:01.695667 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:01.695668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:01.695668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:01.695968 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:01.696126 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:01.696259 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 10:05:01.696394 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":93,"threads_started":1}
I20260811 10:05:01.709841 25206 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:05:01.710573 25206 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:05:01.716324 25206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Generated new TSK 0
I20260811 10:05:01.716531 25206 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:05:01.747324 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:43665
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:01.832680 25220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:01.832965 25220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:01.832994 25220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:01.834215 25220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:01.834265 25220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:01.834322 25220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:05:01.835878 25220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:01.836179 25220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:01.836452 25220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:01.841861 25226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:01.841863 25228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:01.841857 25225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:01.842150 25220 server_base.cc:1034] running on GCE node
I20260811 10:05:01.842370 25220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:01.842643 25220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:01.843816 25220 hybrid_clock.cc:648] HybridClock initialized: now 1786442701843791 us; error 36 us; skew 500 ppm
Aug 11 10:05:01 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:01.846338 25220 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:05:01.846752 25220 webserver.cc:460] Webserver started at http://127.9.127.193:35985/ using document root <none> and password file <none>
I20260811 10:05:01.846967 25220 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:01.847009 25220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:01.847121 25220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:01.848198 25220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "f5155a72ad9f496ab8dd129961635e36"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "1e2a1d6bd9cfd6c9de61fe924f2b687f"
server_key_iv: "1e2d3b2f8d45cc343038ed3fd1381ddc"
server_key_version: "encryptionkey@0"
I20260811 10:05:01.848517 25220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "f5155a72ad9f496ab8dd129961635e36"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "1e2a1d6bd9cfd6c9de61fe924f2b687f"
server_key_iv: "1e2d3b2f8d45cc343038ed3fd1381ddc"
server_key_version: "encryptionkey@0"
I20260811 10:05:01.849969 25220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:05:01.850739 25235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:01.850947 25220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 10:05:01.851049 25220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "f5155a72ad9f496ab8dd129961635e36"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "1e2a1d6bd9cfd6c9de61fe924f2b687f"
server_key_iv: "1e2d3b2f8d45cc343038ed3fd1381ddc"
server_key_version: "encryptionkey@0"
I20260811 10:05:01.851114 25220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:01.874686 25220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:01.876914 25220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:01.877059 25220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:01.877271 25220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:01.877537 25220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:01.877568 25220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:01.877590 25220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:01.877604 25220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:01.883312 25220 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:44223
I20260811 10:05:01.883404 25363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:44223 every 8 connection(s)
I20260811 10:05:01.883737 25220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
Aug 11 10:05:01 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442701, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:01.893154 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:01.884570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:45087 (local address 127.9.127.254:43665)
0811 10:05:01.884616 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:01.884618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:01.884916 (+ 298us) server_negotiation.cc:407] Connection header received
0811 10:05:01.885473 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:01.885474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:01.885492 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:01.885549 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:01.886555 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:01.887073 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:01.888147 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:01.888368 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:01.888447 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:01.890626 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:01.890628 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:01.890628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:01.890637 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:01.891901 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:01.892279 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:01.892279 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:01.892280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:01.892333 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:01.892548 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:01.892549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:01.892549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:01.892652 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:01.892703 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:01.893011 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 10:05:01.893086 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:05:01.893298 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:01.884521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:45087)
0811 10:05:01.884744 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:01.884817 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:01.885360 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:01.885625 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:01.885629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:01.886208 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:01.886416 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:01.886421 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:01.887176 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:01.887177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:01.888055 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:01.888058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:01.888457 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:01.888465 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:01.888594 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:01.889136 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:01.889145 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:01.890534 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:01.891976 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:01.891983 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:01.891985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:01.892210 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:01.892392 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:01.892393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:01.892393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:01.892493 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:01.892705 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:01.892710 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:01.892880 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 10:05:01.892968 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 10:05:01.893096 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":122,"threads_started":1}
I20260811 10:05:01.893673 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 25220
I20260811 10:05:01.893814 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:05:01.893875 25364 heartbeater.cc:347] Connected to a master server at 127.9.127.254:43665
I20260811 10:05:01.893980 25364 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:01.894037 9727 external_mini_cluster.cc:1428] Setting key 34003741f3e5fce3f44bd4b865014255
I20260811 10:05:01.894172 25364 heartbeater.cc:511] Master 127.9.127.254:43665 requested a full tablet report, sending...
I20260811 10:05:01.894838 25150 ts_manager.cc:194] Registered new tserver with Master: f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223)
I20260811 10:05:01.895747 25150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:45087
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:05:01.921888 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:43665
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:02.006033 25369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:02.006412 25369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:02.006470 25369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:02.007673 25369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:02.007714 25369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:02.007741 25369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:05:02.009171 25369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:02.009358 25369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:02.009534 25369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:02.014588 25375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.014559 25378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.014756 25369 server_base.cc:1034] running on GCE node
W20260811 10:05:02.014559 25376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.015000 25369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:02.015262 25369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:02.016407 25369 hybrid_clock.cc:648] HybridClock initialized: now 1786442702016398 us; error 32 us; skew 500 ppm
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:02.019061 25369 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:05:02.019569 25369 webserver.cc:460] Webserver started at http://127.9.127.194:41867/ using document root <none> and password file <none>
I20260811 10:05:02.019805 25369 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:02.019872 25369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:02.020042 25369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:02.021200 25369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "8921ea8426be4c20b5e2a2abdec5a586"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "e22de43c51ca23933075590ececf7bb7"
server_key_iv: "9eba56d5d007b1e516130cf8c9e012df"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.021572 25369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "8921ea8426be4c20b5e2a2abdec5a586"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "e22de43c51ca23933075590ececf7bb7"
server_key_iv: "9eba56d5d007b1e516130cf8c9e012df"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.023088 25369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:05:02.023835 25385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.024005 25369 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:02.024123 25369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "8921ea8426be4c20b5e2a2abdec5a586"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "e22de43c51ca23933075590ececf7bb7"
server_key_iv: "9eba56d5d007b1e516130cf8c9e012df"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.024199 25369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:02.055575 25369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:02.058082 25369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:02.058207 25369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:02.058406 25369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:02.058761 25369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:02.058830 25369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.058876 25369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:02.058902 25369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.065102 25369 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:34387
I20260811 10:05:02.065150 25513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:34387 every 8 connection(s)
I20260811 10:05:02.065532 25369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:05:02.067906 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 25369
I20260811 10:05:02.068027 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:05:02.068235 9727 external_mini_cluster.cc:1428] Setting key c807ce167be009b91a5f7324e4e5519d
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:02.077023 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.066442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:38389 (local address 127.9.127.254:43665)
0811 10:05:02.066532 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.066535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.066638 (+ 103us) server_negotiation.cc:407] Connection header received
0811 10:05:02.067192 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.067194 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.067204 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.067259 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:02.068348 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.069188 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.070778 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.070982 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.071087 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.073474 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:02.073476 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:02.073477 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:02.073486 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:02.075415 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.075849 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.075851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.075851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.075955 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.076218 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.076220 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.076220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.076399 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:02.076491 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.076760 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.076902 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 10:05:02.077105 25516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.066337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:38389)
0811 10:05:02.066519 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.066565 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.067098 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.067316 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.067319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.067946 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:02.068221 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.068228 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.069312 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.069313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.070679 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.070683 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.071104 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.071105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.071281 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.071884 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:02.071894 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:02.073366 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:02.075509 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.075517 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.075519 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.075760 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.076031 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.076032 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.076032 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.076145 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.076476 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:02.076481 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:02.076606 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.076704 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.076907 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":68,"threads_started":1}
I20260811 10:05:02.077713 25514 heartbeater.cc:347] Connected to a master server at 127.9.127.254:43665
I20260811 10:05:02.077845 25514 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:02.078090 25514 heartbeater.cc:511] Master 127.9.127.254:43665 requested a full tablet report, sending...
I20260811 10:05:02.078576 25150 ts_manager.cc:194] Registered new tserver with Master: 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387)
I20260811 10:05:02.078965 25150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:38389
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:05:02.099437 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:43665
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:02.184038 25519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:02.184273 25519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:02.184309 25519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:02.185544 25519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:02.185609 25519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:02.185657 25519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:05:02.187119 25519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:02.187394 25519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:02.187654 25519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:02.193118 25527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.193127 25524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.193137 25525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.193282 25519 server_base.cc:1034] running on GCE node
I20260811 10:05:02.193584 25519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:02.193861 25519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:02.195029 25519 hybrid_clock.cc:648] HybridClock initialized: now 1786442702195030 us; error 44 us; skew 500 ppm
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:02.197803 25519 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:05:02.198287 25519 webserver.cc:460] Webserver started at http://127.9.127.195:35569/ using document root <none> and password file <none>
I20260811 10:05:02.198534 25519 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:02.198609 25519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:02.198763 25519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:02.199870 25519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "b8c854a7d570489f86817cf539dc6624"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "b3ebf75b659aa290f0cf0404d9205143"
server_key_iv: "fa6e975de423082d8b27a01ab7634625"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.200251 25519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "b8c854a7d570489f86817cf539dc6624"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "b3ebf75b659aa290f0cf0404d9205143"
server_key_iv: "fa6e975de423082d8b27a01ab7634625"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.201748 25519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:05:02.202592 25534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.202795 25519 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:02.202908 25519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "b8c854a7d570489f86817cf539dc6624"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "b3ebf75b659aa290f0cf0404d9205143"
server_key_iv: "fa6e975de423082d8b27a01ab7634625"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.202987 25519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:02.217248 25519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:02.219327 25519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:02.219508 25519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:02.219756 25519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:02.220094 25519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:02.220151 25519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.220185 25519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:02.220216 25519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.226491 25519 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:40917
I20260811 10:05:02.226532 25663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:40917 every 8 connection(s)
I20260811 10:05:02.226945 25519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:02.235688 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 25519
I20260811 10:05:02.235797 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:05:02.236037 9727 external_mini_cluster.cc:1428] Setting key 99c1dd714fb088badae52e2ef30a7b69
I20260811 10:05:02.236570 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.227717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:44871 (local address 127.9.127.254:43665)
0811 10:05:02.227772 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.227774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.228005 (+ 231us) server_negotiation.cc:407] Connection header received
0811 10:05:02.228565 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.228566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.228580 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.228625 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:02.229718 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.230220 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.231272 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.231470 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.231558 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.233760 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:02.233761 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:02.233762 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:02.233769 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:02.234977 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.235391 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.235392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.235392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.235445 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.235797 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.235798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.235799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.235945 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:02.236002 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.236373 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.236462 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 10:05:02.236865 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.227686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:44871)
0811 10:05:02.227862 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.227906 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.228447 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.228698 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.228702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.229409 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:02.229613 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.229619 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.230322 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.230324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.231160 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.231163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.231573 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.231582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.231718 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.232218 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:02.232227 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:02.233674 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:02.235069 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.235077 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.235079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.235319 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.235529 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.235530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.235530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.235703 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.236020 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:02.236027 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:02.236209 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.236329 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.236561 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
I20260811 10:05:02.237397 25664 heartbeater.cc:347] Connected to a master server at 127.9.127.254:43665
I20260811 10:05:02.237528 25664 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:02.237758 25664 heartbeater.cc:511] Master 127.9.127.254:43665 requested a full tablet report, sending...
I20260811 10:05:02.238135 25150 ts_manager.cc:194] Registered new tserver with Master: b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917)
I20260811 10:05:02.238541 25150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:44871
I20260811 10:05:02.248230 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:05:02.255762 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.249659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49572 (local address 127.9.127.254:43665)
0811 10:05:02.249732 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.249734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.249857 (+ 123us) server_negotiation.cc:407] Connection header received
0811 10:05:02.249901 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.249902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.249912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.249963 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:02.250520 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.251009 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.251689 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.251867 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.251915 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.253170 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:02.253171 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:02.253172 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:02.253178 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:02.254495 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.254883 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.254884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.254885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.254953 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.255156 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.255157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.255157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.255320 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:02.255425 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.255574 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.255656 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 10:05:02.257316 25150 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:05:02.258836 25150 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:05:02.265607 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.261525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57068 (local address 127.9.127.193:44223)
0811 10:05:02.261710 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.261714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.261723 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:05:02.261796 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.261798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.261811 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.261913 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:02.262188 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.263362 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.264503 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.265155 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.265243 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.265308 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.265479 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.265521 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":83,"threads_started":1}
I20260811 10:05:02.265609 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.261233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:44223 (local address 127.0.0.1:57068)
0811 10:05:02.261605 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.261614 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.261659 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.262021 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.262024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.262027 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:02.262097 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.262099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.263510 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.263511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.264384 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.264387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.265255 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.265256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.265343 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.265357 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.265458 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.265517 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":6,"thread_start_us":137,"threads_started":1}
I20260811 10:05:02.265789 25680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.261330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46624 (local address 127.9.127.194:34387)
0811 10:05:02.261523 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.261528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.261861 (+ 333us) server_negotiation.cc:407] Connection header received
0811 10:05:02.261915 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.261918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.261935 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.262011 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:02.262305 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.263003 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.264452 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.265266 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.265338 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.265395 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.265657 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.265698 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":77,"threads_started":1}
I20260811 10:05:02.265959 25681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.261444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52510 (local address 127.9.127.195:40917)
0811 10:05:02.261937 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.261942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.261951 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:05:02.261991 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.261993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.262007 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.262074 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:02.262282 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.263373 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.264644 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.265386 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.265462 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.265517 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.265826 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.265878 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":91,"threads_started":1}
I20260811 10:05:02.265743 25677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.261233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:40917 (local address 127.0.0.1:52510)
0811 10:05:02.261454 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.261500 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.261571 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.262152 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.262153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.262154 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:02.262200 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.262201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.263477 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.263478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.264555 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.264557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.265548 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.265549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.265600 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.265603 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.265649 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.265682 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":3,"thread_start_us":49,"threads_started":1}
I20260811 10:05:02.265955 25678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.261240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:34387 (local address 127.0.0.1:46624)
0811 10:05:02.261727 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.261739 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.261799 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.262121 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.262122 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.262125 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:02.262196 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.262197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.263121 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.263123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.264353 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.264356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.265433 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.265434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.265498 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.265502 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.265552 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.265594 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":1,"thread_start_us":143,"threads_started":1}
I20260811 10:05:02.266695 25290 tablet_service.cc:1467] Processing CreateTablet for tablet ccbc1b63f6184ada98797c16a835ca66 (DEFAULT_TABLE table=test-table [id=ff0fddccd61a4761956e66351bc6d13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:02.266842 25440 tablet_service.cc:1467] Processing CreateTablet for tablet ccbc1b63f6184ada98797c16a835ca66 (DEFAULT_TABLE table=test-table [id=ff0fddccd61a4761956e66351bc6d13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:02.266842 25590 tablet_service.cc:1467] Processing CreateTablet for tablet ccbc1b63f6184ada98797c16a835ca66 (DEFAULT_TABLE table=test-table [id=ff0fddccd61a4761956e66351bc6d13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:02.267081 25290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccbc1b63f6184ada98797c16a835ca66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:02.267171 25590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccbc1b63f6184ada98797c16a835ca66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:02.267171 25440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccbc1b63f6184ada98797c16a835ca66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:02.269940 25683 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Bootstrap starting.
I20260811 10:05:02.270509 25685 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Bootstrap starting.
I20260811 10:05:02.270709 25683 tablet_bootstrap.cc:654] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:02.270756 25686 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: Bootstrap starting.
I20260811 10:05:02.271369 25683 log.cc:824] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:02.271472 25686 tablet_bootstrap.cc:654] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:02.272051 25686 log.cc:824] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:02.272243 25683 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: No bootstrap required, opened a new log
I20260811 10:05:02.272316 25685 tablet_bootstrap.cc:654] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:02.272331 25683 ts_tablet_manager.cc:1397] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:05:02.272943 25686 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: No bootstrap required, opened a new log
I20260811 10:05:02.273023 25685 log.cc:824] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:02.273073 25686 ts_tablet_manager.cc:1397] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:05:02.273824 25685 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: No bootstrap required, opened a new log
I20260811 10:05:02.273900 25685 ts_tablet_manager.cc:1397] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 10:05:02.274216 25683 raft_consensus.cc:348] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.274386 25683 raft_consensus.cc:374] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:02.274431 25683 raft_consensus.cc:729] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5155a72ad9f496ab8dd129961635e36, State: Initialized, Role: FOLLOWER
I20260811 10:05:02.274595 25683 consensus_queue.cc:260] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.274897 25683 ts_tablet_manager.cc:1428] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:05:02.274905 25364 heartbeater.cc:503] Master 127.9.127.254:43665 was elected leader, sending a full tablet report...
I20260811 10:05:02.275030 25686 raft_consensus.cc:348] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.275203 25686 raft_consensus.cc:374] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:02.275243 25686 raft_consensus.cc:729] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c854a7d570489f86817cf539dc6624, State: Initialized, Role: FOLLOWER
I20260811 10:05:02.275355 25686 consensus_queue.cc:260] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.275616 25686 ts_tablet_manager.cc:1428] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:05:02.275758 25664 heartbeater.cc:503] Master 127.9.127.254:43665 was elected leader, sending a full tablet report...
I20260811 10:05:02.276268 25685 raft_consensus.cc:348] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.276485 25685 raft_consensus.cc:374] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:02.276539 25685 raft_consensus.cc:729] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8921ea8426be4c20b5e2a2abdec5a586, State: Initialized, Role: FOLLOWER
I20260811 10:05:02.276676 25685 consensus_queue.cc:260] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.277010 25685 ts_tablet_manager.cc:1428] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 10:05:02.277037 25514 heartbeater.cc:503] Master 127.9.127.254:43665 was elected leader, sending a full tablet report...
W20260811 10:05:02.316228 25515 tablet.cc:2369] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:05:02.384671 25365 tablet.cc:2369] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:05:02.386086 25691 raft_consensus.cc:482] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:02.386201 25691 raft_consensus.cc:504] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.386647 25691 leader_election.cc:288] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387), f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223)
I20260811 10:05:02.390245 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.386923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:35261 (local address 127.9.127.193:44223)
0811 10:05:02.386986 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.386989 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.387037 (+ 48us) server_negotiation.cc:407] Connection header received
0811 10:05:02.387071 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.387072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.387083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.387136 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:02.387349 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.387970 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.389305 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.389869 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.389948 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.389959 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.390155 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.390193 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 10:05:02.390249 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.386852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:44223 (local address 127.9.127.195:35261)
0811 10:05:02.386923 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.386936 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.386983 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.387168 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.387169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.387171 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:02.387258 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.387260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.388069 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.388071 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.389194 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.389198 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.389973 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.389974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.390064 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.390068 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.390130 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.390173 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 10:05:02.390627 25313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccbc1b63f6184ada98797c16a835ca66" candidate_uuid: "b8c854a7d570489f86817cf539dc6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5155a72ad9f496ab8dd129961635e36" is_pre_election: true
I20260811 10:05:02.390807 25313 raft_consensus.cc:2454] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c854a7d570489f86817cf539dc6624 in term 0.
I20260811 10:05:02.391007 25693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.386852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:34387 (local address 127.9.127.195:35783)
0811 10:05:02.387113 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.387141 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.387197 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.387852 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.387854 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.387856 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:02.387926 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.387928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.388902 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.388903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.389976 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.389980 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.390707 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.390708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.390803 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.390807 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.390867 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.390912 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":62,"thread_start_us":123,"threads_started":1}
I20260811 10:05:02.391024 25680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.386947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:35783 (local address 127.9.127.194:34387)
0811 10:05:02.386992 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.386994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.387193 (+ 199us) server_negotiation.cc:407] Connection header received
0811 10:05:02.387261 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.387262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.387270 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.387333 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:02.388063 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.388830 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.390068 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.390620 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.390707 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.390715 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.390894 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.390945 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:05:02.391086 25539 leader_election.cc:302] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c854a7d570489f86817cf539dc6624, f5155a72ad9f496ab8dd129961635e36; no voters:
I20260811 10:05:02.391206 25691 raft_consensus.cc:2781] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:05:02.391273 25691 raft_consensus.cc:482] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:05:02.391305 25691 raft_consensus.cc:3037] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:02.391482 25464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccbc1b63f6184ada98797c16a835ca66" candidate_uuid: "b8c854a7d570489f86817cf539dc6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8921ea8426be4c20b5e2a2abdec5a586" is_pre_election: true
I20260811 10:05:02.391636 25464 raft_consensus.cc:2454] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c854a7d570489f86817cf539dc6624 in term 0.
I20260811 10:05:02.392216 25691 raft_consensus.cc:504] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.392367 25691 leader_election.cc:288] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [CANDIDATE]: Term 1 election: Requested vote from peers 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387), f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223)
I20260811 10:05:02.392535 25464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccbc1b63f6184ada98797c16a835ca66" candidate_uuid: "b8c854a7d570489f86817cf539dc6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8921ea8426be4c20b5e2a2abdec5a586"
I20260811 10:05:02.392563 25313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccbc1b63f6184ada98797c16a835ca66" candidate_uuid: "b8c854a7d570489f86817cf539dc6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5155a72ad9f496ab8dd129961635e36"
I20260811 10:05:02.392632 25464 raft_consensus.cc:3037] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:02.392643 25313 raft_consensus.cc:3037] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:02.393638 25464 raft_consensus.cc:2454] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c854a7d570489f86817cf539dc6624 in term 1.
I20260811 10:05:02.393647 25313 raft_consensus.cc:2454] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c854a7d570489f86817cf539dc6624 in term 1.
I20260811 10:05:02.393867 25537 leader_election.cc:302] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8921ea8426be4c20b5e2a2abdec5a586, b8c854a7d570489f86817cf539dc6624; no voters:
I20260811 10:05:02.393977 25691 raft_consensus.cc:2781] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:05:02.394143 25691 raft_consensus.cc:686] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 1 LEADER]: Becoming Leader. State: Replica: b8c854a7d570489f86817cf539dc6624, State: Running, Role: LEADER
I20260811 10:05:02.394258 25691 consensus_queue.cc:237] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.395130 25151 catalog_manager.cc:5495] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c854a7d570489f86817cf539dc6624 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "b8c854a7d570489f86817cf539dc6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } health_report { overall_health: HEALTHY } } }
I20260811 10:05:02.413796 25681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.411239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52518 (local address 127.9.127.195:40917)
0811 10:05:02.411301 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.411303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.411313 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:05:02.411400 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.411401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.411421 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.411517 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:05:02.411665 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.412139 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.412969 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.413168 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.413257 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.413423 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:05:02.413541 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:05:02.413633 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.413657 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.413679 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:05:02.415723 25313 raft_consensus.cc:1261] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Refusing update from remote peer b8c854a7d570489f86817cf539dc6624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:05:02.415723 25464 raft_consensus.cc:1261] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Refusing update from remote peer b8c854a7d570489f86817cf539dc6624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:05:02.416188 25694 consensus_queue.cc:1035] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:05:02.416353 25691 consensus_queue.cc:1035] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:05:02.419881 25699 mvcc.cc:205] Tried to move back new op lower bound from 7317269309092069376 to 7317269309007650816. Current Snapshot: MvccSnapshot[applied={T|T < 7317269309092069376}]
I20260811 10:05:02.420017 25697 mvcc.cc:205] Tried to move back new op lower bound from 7317269309092069376 to 7317269309007650816. Current Snapshot: MvccSnapshot[applied={T|T < 7317269309092069376 or (T in {7317269309092069376})}]
I20260811 10:05:02.421398 25150 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:05:02.421495 25150 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:05:02.422429 25150 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Sending DeleteTablet for 3 replicas of tablet ccbc1b63f6184ada98797c16a835ca66
I20260811 10:05:02.422834 25590 tablet_service.cc:1514] Processing DeleteTablet for tablet ccbc1b63f6184ada98797c16a835ca66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:02 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:52510
I20260811 10:05:02.422843 25290 tablet_service.cc:1514] Processing DeleteTablet for tablet ccbc1b63f6184ada98797c16a835ca66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:02 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:57068
I20260811 10:05:02.422860 25440 tablet_service.cc:1514] Processing DeleteTablet for tablet ccbc1b63f6184ada98797c16a835ca66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:02 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:46624
I20260811 10:05:02.423188 25709 tablet_replica.cc:330] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: stopping tablet replica
I20260811 10:05:02.423265 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 25220
I20260811 10:05:02.423295 25709 raft_consensus.cc:2229] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:05:02.436468 25709 raft_consensus.cc:2258] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:02.436918 25708 tablet_replica.cc:330] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: stopping tablet replica
I20260811 10:05:02.437060 25708 raft_consensus.cc:2229] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:05:02.437184 25708 raft_consensus.cc:2258] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:02.437196 25709 ts_tablet_manager.cc:1905] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:02.437671 25708 ts_tablet_manager.cc:1905] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:02.439127 25709 ts_tablet_manager.cc:1918] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:02.439219 25709 log.cc:1196] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/ccbc1b63f6184ada98797c16a835ca66
I20260811 10:05:02.439385 25708 ts_tablet_manager.cc:1918] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:02.439453 25708 log.cc:1196] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/ccbc1b63f6184ada98797c16a835ca66
I20260811 10:05:02.439543 25709 ts_tablet_manager.cc:1939] T ccbc1b63f6184ada98797c16a835ca66 P 8921ea8426be4c20b5e2a2abdec5a586: Deleting consensus metadata
I20260811 10:05:02.439743 25708 ts_tablet_manager.cc:1939] T ccbc1b63f6184ada98797c16a835ca66 P b8c854a7d570489f86817cf539dc6624: Deleting consensus metadata
I20260811 10:05:02.440089 25136 catalog_manager.cc:4841] TS 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387): tablet ccbc1b63f6184ada98797c16a835ca66 (table test-table [id=ff0fddccd61a4761956e66351bc6d13b]) successfully deleted
I20260811 10:05:02.440100 25137 catalog_manager.cc:4841] TS b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917): tablet ccbc1b63f6184ada98797c16a835ca66 (table test-table [id=ff0fddccd61a4761956e66351bc6d13b]) successfully deleted
W20260811 10:05:02.442011 25138 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:44223 (error 108)
I20260811 10:05:02.442589 25677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.442419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:44223 (local address 127.0.0.1:57070)
0811 10:05:02.442481 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.442520 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:44223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 10:05:02.442667 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 25369
W20260811 10:05:02.445188 25138 catalog_manager.cc:4584] TS f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ccbc1b63f6184ada98797c16a835ca66: Network error: Client connection negotiation failed: client connection to 127.9.127.193:44223: connect: Connection refused (error 111)
I20260811 10:05:02.450148 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 25519
I20260811 10:05:02.457432 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 25116
I20260811 10:05:02.466146 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:43665
--webserver_interface=127.9.127.254
--webserver_port=44301
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:43665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:02.553653 25712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:02.553879 25712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:02.553905 25712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:02.555150 25712 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:05:02.555194 25712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:02.555208 25712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:02.555222 25712 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:05:02.555234 25712 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:05:02.556819 25712 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:43665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:43665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=44301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:02.557091 25712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:02.557346 25712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:02.568951 25722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.568979 25719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.568951 25720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.569221 25712 server_base.cc:1034] running on GCE node
I20260811 10:05:02.569506 25712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:02.569845 25712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:02.571000 25712 hybrid_clock.cc:648] HybridClock initialized: now 1786442702570976 us; error 44 us; skew 500 ppm
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:02.573879 25712 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:05:02.574411 25712 webserver.cc:460] Webserver started at http://127.9.127.254:44301/ using document root <none> and password file <none>
I20260811 10:05:02.574671 25712 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:02.574765 25712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:02.576203 25712 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:05:02.576983 25730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.577186 25712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:02.577303 25712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6398a803c3a24508b8192b2ef7d8e1c0"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "b58c8fe8b2c29214a0900590a7862369"
server_key_iv: "65dae8b19ccd1fe4a54ff793bbb38424"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.577732 25712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:02.591068 25712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:02.593672 25712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:02.593848 25712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:02.598157 25712 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:43665
I20260811 10:05:02.598196 25788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:43665 every 8 connection(s)
I20260811 10:05:02.598619 25712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:05:02.600391 25789 sys_catalog.cc:263] Verifying existing consensus state
I20260811 10:05:02.601130 25789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Bootstrap starting.
I20260811 10:05:02.601976 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 25712
I20260811 10:05:02.602309 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:44223
--local_ip_for_outbound_sockets=127.9.127.193
--tserver_master_addrs=127.9.127.254:43665
--webserver_port=35985
--webserver_interface=127.9.127.193
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:05:02.611045 25789 log.cc:824] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:02.613166 25789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:05:02.613502 25789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Bootstrap complete.
I20260811 10:05:02.615922 25789 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:02.616156 25789 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6398a803c3a24508b8192b2ef7d8e1c0, State: Initialized, Role: FOLLOWER
I20260811 10:05:02.616345 25789 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:02.616407 25789 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:05:02.616487 25789 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:05:02.616541 25789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 10:05:02.617668 25789 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:02.617758 25789 leader_election.cc:302] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6398a803c3a24508b8192b2ef7d8e1c0; no voters:
I20260811 10:05:02.617975 25789 leader_election.cc:288] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 10:05:02.618021 25793 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 10:05:02.618139 25793 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 2 LEADER]: Becoming Leader. State: Replica: 6398a803c3a24508b8192b2ef7d8e1c0, State: Running, Role: LEADER
I20260811 10:05:02.618233 25793 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:02.618268 25789 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:05:02.618692 25794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6398a803c3a24508b8192b2ef7d8e1c0. Latest consensus state: current_term: 2 leader_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } } }
I20260811 10:05:02.618774 25794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:02.619050 25797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:05:02.619493 25795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } } }
I20260811 10:05:02.619585 25795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:02.619875 25797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:05:02.619990 25797 catalog_manager.cc:1259] Loaded cluster ID: 823a54ae68bf40d1b7586ebecce55e45
I20260811 10:05:02.620023 25797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:05:02.620385 25797 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 10:05:02.625051 25797 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 10:05:02.628211 25797 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:05:02.628414 25797 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Loaded TSK: 0
I20260811 10:05:02.628643 25797 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 10:05:02.689499 25791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:02.689750 25791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:02.689791 25791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:02.690964 25791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:02.691033 25791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:02.691080 25791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:05:02.692627 25791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:44223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=35985
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:02.692919 25791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:02.693166 25791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:02.699185 25817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.699193 25816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.699438 25791 server_base.cc:1034] running on GCE node
W20260811 10:05:02.699512 25819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.699743 25791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:02.699997 25791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:02.701164 25791 hybrid_clock.cc:648] HybridClock initialized: now 1786442702701137 us; error 43 us; skew 500 ppm
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:02.703884 25791 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:05:02.704425 25791 webserver.cc:460] Webserver started at http://127.9.127.193:35985/ using document root <none> and password file <none>
I20260811 10:05:02.704689 25791 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:02.704779 25791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:02.706247 25791 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:02.706959 25828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.707109 25791 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:05:02.707207 25791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "f5155a72ad9f496ab8dd129961635e36"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "1e2a1d6bd9cfd6c9de61fe924f2b687f"
server_key_iv: "1e2d3b2f8d45cc343038ed3fd1381ddc"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.707553 25791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:02.735325 25791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:02.737696 25791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:02.737874 25791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:02.738170 25791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:02.738765 25835 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 10:05:02.740343 25791 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 10:05:02.740396 25791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 10:05:02.740430 25791 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 10:05:02.741238 25791 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 10:05:02.741287 25791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:02.741331 25835 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Bootstrap starting.
I20260811 10:05:02.749301 25791 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:44223
I20260811 10:05:02.749498 25953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:44223 every 8 connection(s)
I20260811 10:05:02.749850 25791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:05:02.753281 25835 log.cc:824] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:02.755458 25835 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:05:02.755795 25835 tablet_bootstrap.cc:492] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Bootstrap complete.
I20260811 10:05:02.757196 25835 ts_tablet_manager.cc:1397] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.012s
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:02.758540 25835 raft_consensus.cc:348] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.758882 25835 raft_consensus.cc:729] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5155a72ad9f496ab8dd129961635e36, State: Initialized, Role: FOLLOWER
I20260811 10:05:02.758937 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 25791
I20260811 10:05:02.759068 25835 consensus_queue.cc:260] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } } peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } }
I20260811 10:05:02.759238 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:34387
--local_ip_for_outbound_sockets=127.9.127.194
--tserver_master_addrs=127.9.127.254:43665
--webserver_port=41867
--webserver_interface=127.9.127.194
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:05:02.759383 25835 ts_tablet_manager.cc:1428] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 10:05:02.761713 25956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.750614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:57917)
0811 10:05:02.750984 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.751030 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.751588 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.752069 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.752073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.752366 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:02.752558 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.752563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.753928 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.753929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.754766 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.754768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.755396 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.755398 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.755543 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.756076 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:02.756087 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:02.757925 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:02.759999 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.760006 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.760009 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.760234 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.760530 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.760531 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.760531 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.760639 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.761080 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:02.761087 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:02.761223 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.761335 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.761516 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":89,"threads_started":1}
I20260811 10:05:02.761713 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.750748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:57917 (local address 127.9.127.254:43665)
0811 10:05:02.750975 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.750985 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.751162 (+ 177us) server_negotiation.cc:407] Connection header received
0811 10:05:02.751831 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.751836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.751881 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.752017 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:02.752689 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.753694 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.754866 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.755280 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.755406 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.758042 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:02.758045 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:02.758046 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:02.758056 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:02.759889 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.760338 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.760341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.760342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.760436 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.760717 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.760718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.760719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.761005 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:02.761099 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.761391 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.761528 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
I20260811 10:05:02.762562 25954 heartbeater.cc:347] Connected to a master server at 127.9.127.254:43665
I20260811 10:05:02.762656 25954 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:02.762823 25954 heartbeater.cc:511] Master 127.9.127.254:43665 requested a full tablet report, sending...
I20260811 10:05:02.763561 25747 ts_manager.cc:194] Registered new tserver with Master: f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223)
I20260811 10:05:02.764662 25747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:57917
I20260811 10:05:02.765558 25954 heartbeater.cc:503] Master 127.9.127.254:43665 was elected leader, sending a full tablet report...
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:05:02.773159 25962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.764181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:44223 (local address 127.0.0.1:57078)
0811 10:05:02.764532 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.764576 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.764673 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.764970 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.764978 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.765377 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:02.765452 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.765456 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.766477 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.766478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.767511 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.767516 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.767963 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.767965 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.768063 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.768572 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:02.768578 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:02.770156 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:02.771938 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.771946 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.771948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.772156 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.772385 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.772385 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.772386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.772450 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.772734 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:02.772742 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:02.772817 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.772918 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.773058 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":86,"threads_started":1}
I20260811 10:05:02.773157 25963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.764271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57078 (local address 127.9.127.193:44223)
0811 10:05:02.764449 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.764454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.764674 (+ 220us) server_negotiation.cc:407] Connection header received
0811 10:05:02.764852 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.764854 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.764869 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.765031 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:02.765555 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.766395 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.767613 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.767885 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.767936 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.770260 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:02.770269 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:02.770269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:02.770282 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:02.771831 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.772243 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.772246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.772247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.772309 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.772513 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.772513 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.772514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.772659 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:02.772755 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.772971 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.773061 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260811 10:05:02.773612 25879 tablet_service.cc:1514] Processing DeleteTablet for tablet ccbc1b63f6184ada98797c16a835ca66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:02 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:57078
I20260811 10:05:02.774168 25964 tablet_replica.cc:330] stopping tablet replica
I20260811 10:05:02.774286 25964 raft_consensus.cc:2229] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:05:02.774358 25964 raft_consensus.cc:2258] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:02.774681 25964 ts_tablet_manager.cc:1905] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:02.776968 25964 ts_tablet_manager.cc:1918] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:02.777050 25964 log.cc:1196] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/ccbc1b63f6184ada98797c16a835ca66
I20260811 10:05:02.777298 25964 ts_tablet_manager.cc:1939] T ccbc1b63f6184ada98797c16a835ca66 P f5155a72ad9f496ab8dd129961635e36: Deleting consensus metadata
I20260811 10:05:02.777856 25734 catalog_manager.cc:4841] TS f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223): tablet ccbc1b63f6184ada98797c16a835ca66 (table test-table [id=ff0fddccd61a4761956e66351bc6d13b]) successfully deleted
W20260811 10:05:02.849282 25961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:02.849488 25961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:02.849511 25961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:02.850705 25961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:02.850749 25961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:02.850776 25961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:05:02.852218 25961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:34387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=41867
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:02.852455 25961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:02.852689 25961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:02.857774 25969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.857889 25961 server_base.cc:1034] running on GCE node
W20260811 10:05:02.857757 25972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.857750 25970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.858202 25961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:02.858472 25961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:02.859618 25961 hybrid_clock.cc:648] HybridClock initialized: now 1786442702859607 us; error 30 us; skew 500 ppm
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:02.862174 25961 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:05:02.862655 25961 webserver.cc:460] Webserver started at http://127.9.127.194:41867/ using document root <none> and password file <none>
I20260811 10:05:02.862885 25961 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:02.862970 25961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:02.864312 25961 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:02.864962 25979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.865154 25961 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:02.865264 25961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "8921ea8426be4c20b5e2a2abdec5a586"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "e22de43c51ca23933075590ececf7bb7"
server_key_iv: "9eba56d5d007b1e516130cf8c9e012df"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.865607 25961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:02.874877 25961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:02.876715 25961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:02.876935 25961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:02.877192 25961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:02.877506 25961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:02.877563 25961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.877597 25961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:02.877630 25961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.883839 25961 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:34387
I20260811 10:05:02.883910 26103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:34387 every 8 connection(s)
I20260811 10:05:02.884302 25961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:05:02.885603 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 25961
I20260811 10:05:02.885903 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:40917
--local_ip_for_outbound_sockets=127.9.127.195
--tserver_master_addrs=127.9.127.254:43665
--webserver_port=35569
--webserver_interface=127.9.127.195
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:02.894632 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.885122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:58755 (local address 127.9.127.254:43665)
0811 10:05:02.885190 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:02.885192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:02.885397 (+ 205us) server_negotiation.cc:407] Connection header received
0811 10:05:02.885978 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:02.885979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:02.885997 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:02.886054 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:02.887027 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.887712 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.888742 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.889061 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.889145 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.891656 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:02.891662 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:02.891662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:02.891670 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:02.893141 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.893559 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.893561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.893561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.893632 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:02.893905 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:02.893906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:02.893907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:02.894022 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:02.894115 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:02.894411 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 10:05:02.894510 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 10:05:02.894795 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:02.885099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:58755)
0811 10:05:02.885262 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:02.885305 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:02.885864 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:02.886135 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:02.886139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:02.886719 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:02.886917 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.886921 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.887826 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.887827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.888641 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:02.888643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:02.889171 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:02.889174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:02.889302 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:02.889851 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:02.889860 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:02.891529 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:02.893228 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.893236 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.893238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.893468 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.893704 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:02.893705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:02.893706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:02.893827 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:02.894108 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:02.894116 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:02.894266 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 10:05:02.894377 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 10:05:02.894541 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260811 10:05:02.895463 26104 heartbeater.cc:347] Connected to a master server at 127.9.127.254:43665
I20260811 10:05:02.895586 26104 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:02.895808 26104 heartbeater.cc:511] Master 127.9.127.254:43665 requested a full tablet report, sending...
I20260811 10:05:02.896270 25747 ts_manager.cc:194] Registered new tserver with Master: 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387)
I20260811 10:05:02.896658 25747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:58755
W20260811 10:05:02.973987 26107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:02.974220 26107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:02.974259 26107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:02.975426 26107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:02.975495 26107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:02.975539 26107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:05:02.977115 26107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:40917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=35569
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:02.977375 26107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:02.977614 26107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 10:05:02.982755 26107 server_base.cc:1034] running on GCE node
W20260811 10:05:02.982726 26113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.982721 26115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:02.982702 26112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:02.983130 26107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:02.983340 26107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:02.984479 26107 hybrid_clock.cc:648] HybridClock initialized: now 1786442702984466 us; error 29 us; skew 500 ppm
Aug 11 10:05:02 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:02.987383 26107 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:05:02.987816 26107 webserver.cc:460] Webserver started at http://127.9.127.195:35569/ using document root <none> and password file <none>
I20260811 10:05:02.988063 26107 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:02.988153 26107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:02.989604 26107 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:02.990176 26124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:02.990345 26107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:02.990444 26107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "b8c854a7d570489f86817cf539dc6624"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "b3ebf75b659aa290f0cf0404d9205143"
server_key_iv: "fa6e975de423082d8b27a01ab7634625"
server_key_version: "encryptionkey@0"
I20260811 10:05:02.990798 26107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:03.011978 26107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:03.014518 26107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:03.014643 26107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:03.014853 26107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:03.015125 26107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:03.015157 26107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:03.015182 26107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:03.015194 26107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:03.021298 26107 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:40917
I20260811 10:05:03.021378 26247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:40917 every 8 connection(s)
I20260811 10:05:03.021730 26107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:05:03.022264 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 26107
Aug 11 10:05:03 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442702, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:03.029379 26253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.022803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49582 (local address 127.9.127.254:43665)
0811 10:05:03.022937 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.022939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.022949 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:05:03.022987 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.022987 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.022998 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.023080 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:03.023674 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.024369 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.025153 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.025373 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.025456 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.026720 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:03.026722 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:03.026722 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:03.026730 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:03.028145 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:03.028492 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:03.028493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:03.028494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:03.028561 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:03.028797 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:03.028798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:03.028799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:03.028950 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:03.029130 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.029175 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.029267 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":88,"threads_started":1}
I20260811 10:05:03.031776 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.022774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:47075 (local address 127.9.127.254:43665)
0811 10:05:03.022846 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.022848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.023059 (+ 211us) server_negotiation.cc:407] Connection header received
0811 10:05:03.023597 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.023598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.023610 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.023655 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:03.024704 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.025240 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.026423 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.026633 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.026720 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.029091 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:03.029092 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:03.029093 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:03.029100 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:03.030670 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:03.031040 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:03.031040 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:03.031041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:03.031090 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:03.031268 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:03.031268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:03.031269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:03.031360 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:03.031408 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.031651 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.031715 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:05:03.031952 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.022567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:47075)
0811 10:05:03.022952 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.022990 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:03.023487 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:03.023742 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:03.023745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:03.024398 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:03.024604 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.024610 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.025353 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.025355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.026315 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.026319 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.026735 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.026736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.026860 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.027478 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:03.027488 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:03.028989 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:03.030744 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:03.030750 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:03.030752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:03.030971 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:03.031131 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:03.031131 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:03.031131 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:03.031217 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:03.031417 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:03.031423 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:03.031538 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 10:05:03.031624 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 10:05:03.031747 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":94,"threads_started":1}
I20260811 10:05:03.032418 26249 heartbeater.cc:347] Connected to a master server at 127.9.127.254:43665
I20260811 10:05:03.032518 26249 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:03.032711 26249 heartbeater.cc:511] Master 127.9.127.254:43665 requested a full tablet report, sending...
I20260811 10:05:03.033162 25747 ts_manager.cc:194] Registered new tserver with Master: b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917)
I20260811 10:05:03.033530 25747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:47075
I20260811 10:05:03.041389 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:05:03.044448 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.041759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49586 (local address 127.9.127.254:43665)
0811 10:05:03.041834 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.041837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.041943 (+ 106us) server_negotiation.cc:407] Connection header received
0811 10:05:03.042030 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.042031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.042090 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.042181 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:05:03.042332 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.042812 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.043626 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.043850 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.043925 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.044106 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:05:03.044217 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:05:03.044307 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.044348 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.044366 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 10:05:03.044754 25747 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:49586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:05:03.046479 25747 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:05:03.048594 25879 tablet_service.cc:1467] Processing CreateTablet for tablet 77e8eac35f4b494e8fef701177a28afe (DEFAULT_TABLE table=test-table [id=b154171cd9a04517addda09a54c9267b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:03.048864 25879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e8eac35f4b494e8fef701177a28afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:03.050540 25835 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Bootstrap starting.
I20260811 10:05:03.050848 25835 tablet_bootstrap.cc:654] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:03.051429 25835 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: No bootstrap required, opened a new log
I20260811 10:05:03.051486 25835 ts_tablet_manager.cc:1397] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:03.051851 25835 raft_consensus.cc:348] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.051924 25835 raft_consensus.cc:374] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:03.051964 25835 raft_consensus.cc:729] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5155a72ad9f496ab8dd129961635e36, State: Initialized, Role: FOLLOWER
I20260811 10:05:03.052013 25835 consensus_queue.cc:260] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.052107 25835 ts_tablet_manager.cc:1428] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 10:05:03.052726 25962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.048354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:40917 (local address 127.0.0.1:52528)
0811 10:05:03.048390 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.048403 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:03.048442 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:03.049269 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:03.049269 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:03.049271 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:03.049315 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.049316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.050347 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.050348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.051379 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.051383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.052452 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.052454 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.052531 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.052549 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 10:05:03.052610 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 10:05:03.052655 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 10:05:03.052994 26257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.048876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.9.127.195:40917)
0811 10:05:03.049067 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.049072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.049084 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:05:03.049131 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.049133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.049150 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.049387 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:03.049437 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.050239 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.051487 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.052373 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.052435 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.052476 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.052857 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.052900 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260811 10:05:03.053526 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.048488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46628 (local address 127.9.127.194:34387)
0811 10:05:03.048730 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.048735 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.049182 (+ 447us) server_negotiation.cc:407] Connection header received
0811 10:05:03.049281 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.049284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.049301 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.049699 (+ 398us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:03.049820 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.050859 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.052051 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.053129 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.053215 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.053270 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.053400 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.053442 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":123,"threads_started":1}
I20260811 10:05:03.053575 26256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.048353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:34387 (local address 127.0.0.1:46628)
0811 10:05:03.049100 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.049110 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:03.049206 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:03.049712 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:03.049713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:03.049715 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:03.049753 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.049754 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.051004 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.051006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.051950 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.051953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.053230 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.053231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.053299 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.053302 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:05:03.053384 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 10:05:03.053426 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":298,"thread_start_us":91,"threads_started":1}
I20260811 10:05:03.053696 26176 tablet_service.cc:1467] Processing CreateTablet for tablet 77e8eac35f4b494e8fef701177a28afe (DEFAULT_TABLE table=test-table [id=b154171cd9a04517addda09a54c9267b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:03.054093 26176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e8eac35f4b494e8fef701177a28afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:03.054267 26030 tablet_service.cc:1467] Processing CreateTablet for tablet 77e8eac35f4b494e8fef701177a28afe (DEFAULT_TABLE table=test-table [id=b154171cd9a04517addda09a54c9267b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:03.054514 26030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e8eac35f4b494e8fef701177a28afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:03.056967 26259 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Bootstrap starting.
I20260811 10:05:03.057049 26260 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Bootstrap starting.
I20260811 10:05:03.057720 26259 tablet_bootstrap.cc:654] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:03.057720 26260 tablet_bootstrap.cc:654] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:03.058357 26259 log.cc:824] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:03.058357 26260 log.cc:824] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:03.059154 26260 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: No bootstrap required, opened a new log
I20260811 10:05:03.059231 26260 ts_tablet_manager.cc:1397] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:05:03.059321 26259 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: No bootstrap required, opened a new log
I20260811 10:05:03.059389 26259 ts_tablet_manager.cc:1397] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:05:03.061295 26259 raft_consensus.cc:348] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.061285 26260 raft_consensus.cc:348] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.061486 26260 raft_consensus.cc:374] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:03.061486 26259 raft_consensus.cc:374] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:03.061527 26259 raft_consensus.cc:729] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c854a7d570489f86817cf539dc6624, State: Initialized, Role: FOLLOWER
I20260811 10:05:03.061527 26260 raft_consensus.cc:729] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8921ea8426be4c20b5e2a2abdec5a586, State: Initialized, Role: FOLLOWER
I20260811 10:05:03.061655 26260 consensus_queue.cc:260] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.061655 26259 consensus_queue.cc:260] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.061964 26260 ts_tablet_manager.cc:1428] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:05:03.061964 26259 ts_tablet_manager.cc:1428] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:05:03.062021 26249 heartbeater.cc:503] Master 127.9.127.254:43665 was elected leader, sending a full tablet report...
I20260811 10:05:03.062114 26104 heartbeater.cc:503] Master 127.9.127.254:43665 was elected leader, sending a full tablet report...
W20260811 10:05:03.135030 26105 tablet.cc:2369] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:05:03.250824 25955 tablet.cc:2369] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:05:03.272378 26250 tablet.cc:2369] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:05:03.421901 26264 raft_consensus.cc:482] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:03.422049 26264 raft_consensus.cc:504] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.422566 26264 leader_election.cc:288] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387), f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223)
I20260811 10:05:03.426306 25960 raft_consensus.cc:482] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:03.426450 25960 raft_consensus.cc:504] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.426767 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.422792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:34387 (local address 127.9.127.195:57957)
0811 10:05:03.422866 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.422878 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:03.422945 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:03.423182 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:03.423183 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:03.423184 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:03.423274 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.423276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.424239 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.424239 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.425657 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.425661 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.426460 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.426461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.426553 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.426557 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:03.426624 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 10:05:03.426676 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":69}
I20260811 10:05:03.426810 25960 leader_election.cc:288] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917), 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387)
I20260811 10:05:03.426779 26266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.422799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:44223 (local address 127.9.127.195:44509)
0811 10:05:03.423026 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.423035 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:03.423088 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:03.423275 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:03.423276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:03.423277 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:03.423337 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.423339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.424238 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.424239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.425657 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.425661 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.426556 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.426557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.426626 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.426629 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:05:03.426682 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 10:05:03.426712 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":162,"thread_start_us":99,"threads_started":1}
I20260811 10:05:03.427167 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.422834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:57957 (local address 127.9.127.194:34387)
0811 10:05:03.422886 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.422889 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.422929 (+ 40us) server_negotiation.cc:407] Connection header received
0811 10:05:03.423047 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.423048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.423058 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.423155 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:03.423363 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.424141 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.425761 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.426331 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.426411 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.426421 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.427038 (+ 617us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.427091 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 10:05:03.427171 26265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.422868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:44509 (local address 127.9.127.193:44223)
0811 10:05:03.423019 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.423021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.423105 (+ 84us) server_negotiation.cc:407] Connection header received
0811 10:05:03.423137 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.423138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.423170 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.423253 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:03.423410 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.424148 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.425760 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.426384 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.426450 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.426522 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.426706 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.426756 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
I20260811 10:05:03.427464 25901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e8eac35f4b494e8fef701177a28afe" candidate_uuid: "b8c854a7d570489f86817cf539dc6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5155a72ad9f496ab8dd129961635e36" is_pre_election: true
I20260811 10:05:03.427594 25901 raft_consensus.cc:2454] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c854a7d570489f86817cf539dc6624 in term 0.
I20260811 10:05:03.427631 26053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e8eac35f4b494e8fef701177a28afe" candidate_uuid: "b8c854a7d570489f86817cf539dc6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8921ea8426be4c20b5e2a2abdec5a586" is_pre_election: true
I20260811 10:05:03.427784 26053 raft_consensus.cc:2454] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c854a7d570489f86817cf539dc6624 in term 0.
I20260811 10:05:03.427802 26128 leader_election.cc:302] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c854a7d570489f86817cf539dc6624, f5155a72ad9f496ab8dd129961635e36; no voters:
I20260811 10:05:03.427929 26264 raft_consensus.cc:2781] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:05:03.428009 26264 raft_consensus.cc:482] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:05:03.428035 26264 raft_consensus.cc:3037] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:03.429070 26264 raft_consensus.cc:504] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.429400 26053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e8eac35f4b494e8fef701177a28afe" candidate_uuid: "b8c854a7d570489f86817cf539dc6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8921ea8426be4c20b5e2a2abdec5a586"
I20260811 10:05:03.429493 26053 raft_consensus.cc:3037] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:03.429484 25901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e8eac35f4b494e8fef701177a28afe" candidate_uuid: "b8c854a7d570489f86817cf539dc6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5155a72ad9f496ab8dd129961635e36"
I20260811 10:05:03.429569 25901 raft_consensus.cc:3037] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:03.430404 25901 raft_consensus.cc:2454] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c854a7d570489f86817cf539dc6624 in term 1.
I20260811 10:05:03.430469 26053 raft_consensus.cc:2454] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c854a7d570489f86817cf539dc6624 in term 1.
I20260811 10:05:03.430565 26257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.426993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:40365 (local address 127.9.127.195:40917)
0811 10:05:03.427106 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.427108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.427252 (+ 144us) server_negotiation.cc:407] Connection header received
0811 10:05:03.427355 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.427356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.427371 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.427402 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:03.427602 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.428279 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.429643 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.430171 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.430221 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.430230 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.430456 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.430502 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 10:05:03.430637 26128 leader_election.cc:302] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c854a7d570489f86817cf539dc6624, f5155a72ad9f496ab8dd129961635e36; no voters:
I20260811 10:05:03.430821 26264 leader_election.cc:288] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [CANDIDATE]: Term 1 election: Requested vote from peers 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387), f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223)
I20260811 10:05:03.430830 26267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.426955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:40917 (local address 127.9.127.193:40365)
0811 10:05:03.427190 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.427201 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:03.427281 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:03.427482 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:03.427482 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:03.427484 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:03.427524 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.427526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.428366 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.428367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.429527 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.429530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.430296 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.430297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.430365 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.430369 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:03.430692 (+ 323us) client_negotiation.cc:240] Negotiation successful
0811 10:05:03.430747 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":54,"threads_started":1}
I20260811 10:05:03.430887 26264 raft_consensus.cc:2781] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:05:03.430927 26264 raft_consensus.cc:686] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 1 LEADER]: Becoming Leader. State: Replica: b8c854a7d570489f86817cf539dc6624, State: Running, Role: LEADER
I20260811 10:05:03.430943 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.427351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:45921 (local address 127.9.127.194:34387)
0811 10:05:03.427782 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.427784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.427793 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:05:03.427813 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.427814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.427822 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.427877 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:03.428264 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.428822 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.430020 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.430559 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.430613 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.430620 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.430844 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.430880 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411}
I20260811 10:05:03.430965 26268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.427148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:34387 (local address 127.9.127.193:45921)
0811 10:05:03.427276 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.427287 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:03.427338 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:03.428117 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:03.428119 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:03.428120 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:03.428176 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.428178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.428931 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.428932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.429900 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:03.429903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.430680 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.430681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:03.430756 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.430760 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:03.430831 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 10:05:03.430873 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":39,"threads_started":1}
I20260811 10:05:03.431015 26264 consensus_queue.cc:237] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.431102 26199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e8eac35f4b494e8fef701177a28afe" candidate_uuid: "f5155a72ad9f496ab8dd129961635e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c854a7d570489f86817cf539dc6624" is_pre_election: true
I20260811 10:05:03.431167 26053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e8eac35f4b494e8fef701177a28afe" candidate_uuid: "f5155a72ad9f496ab8dd129961635e36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8921ea8426be4c20b5e2a2abdec5a586" is_pre_election: true
I20260811 10:05:03.431262 26053 raft_consensus.cc:2379] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5155a72ad9f496ab8dd129961635e36 in current term 1: Already voted for candidate b8c854a7d570489f86817cf539dc6624 in this term.
I20260811 10:05:03.431505 25830 leader_election.cc:302] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5155a72ad9f496ab8dd129961635e36; no voters: 8921ea8426be4c20b5e2a2abdec5a586, b8c854a7d570489f86817cf539dc6624
I20260811 10:05:03.431656 25960 raft_consensus.cc:2726] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 10:05:03.431900 25746 catalog_manager.cc:5495] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c854a7d570489f86817cf539dc6624 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "b8c854a7d570489f86817cf539dc6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20260811 10:05:03.494313 26257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.490978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52542 (local address 127.9.127.195:40917)
0811 10:05:03.491070 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:03.491073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:03.491083 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:05:03.491176 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:03.491182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:03.491220 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:03.491305 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:05:03.491502 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.492305 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.493383 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:03.493631 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:03.493715 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:03.493914 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:05:03.494048 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:05:03.494159 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:03.494177 (+ 18us) server_negotiation.cc:299] Negotiation successful
0811 10:05:03.494197 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 10:05:03.496385 25901 raft_consensus.cc:1261] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Refusing update from remote peer b8c854a7d570489f86817cf539dc6624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:05:03.496438 26053 raft_consensus.cc:1261] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Refusing update from remote peer b8c854a7d570489f86817cf539dc6624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:05:03.496801 26269 consensus_queue.cc:1035] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:05:03.496954 26264 consensus_queue.cc:1035] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:05:03.499151 26272 mvcc.cc:205] Tried to move back new op lower bound from 7317269313518018560 to 7317269313254076416. Current Snapshot: MvccSnapshot[applied={T|T < 7317269313518018560}]
I20260811 10:05:03.499478 26273 mvcc.cc:205] Tried to move back new op lower bound from 7317269313518018560 to 7317269313254076416. Current Snapshot: MvccSnapshot[applied={T|T < 7317269313518018560}]
I20260811 10:05:03.501482 25746 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:49586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:05:03.501596 25746 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:49586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:05:03.502336 25746 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Sending DeleteTablet for 3 replicas of tablet 77e8eac35f4b494e8fef701177a28afe
I20260811 10:05:03.502676 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 25791
I20260811 10:05:03.502679 25879 tablet_service.cc:1514] Processing DeleteTablet for tablet 77e8eac35f4b494e8fef701177a28afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:03 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:57078
I20260811 10:05:03.502668 26030 tablet_service.cc:1514] Processing DeleteTablet for tablet 77e8eac35f4b494e8fef701177a28afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:03 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:46628
I20260811 10:05:03.505051 26176 tablet_service.cc:1514] Processing DeleteTablet for tablet 77e8eac35f4b494e8fef701177a28afe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:03 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:52528
I20260811 10:05:03.505820 26283 tablet_replica.cc:330] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: stopping tablet replica
I20260811 10:05:03.505908 26283 raft_consensus.cc:2229] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:05:03.505982 26283 raft_consensus.cc:2258] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:03.506098 26282 tablet_replica.cc:330] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: stopping tablet replica
I20260811 10:05:03.506171 26282 raft_consensus.cc:2229] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:05:03.506251 26282 raft_consensus.cc:2258] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:03.506791 26282 ts_tablet_manager.cc:1905] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:03.507515 26283 ts_tablet_manager.cc:1905] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:03.508765 26282 ts_tablet_manager.cc:1918] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:03.508876 26282 log.cc:1196] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/77e8eac35f4b494e8fef701177a28afe
I20260811 10:05:03.509188 26282 ts_tablet_manager.cc:1939] T 77e8eac35f4b494e8fef701177a28afe P 8921ea8426be4c20b5e2a2abdec5a586: Deleting consensus metadata
I20260811 10:05:03.509627 25732 catalog_manager.cc:4841] TS 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387): tablet 77e8eac35f4b494e8fef701177a28afe (table test-table [id=b154171cd9a04517addda09a54c9267b]) successfully deleted
I20260811 10:05:03.509945 26283 ts_tablet_manager.cc:1918] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:03.510028 26283 log.cc:1196] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/77e8eac35f4b494e8fef701177a28afe
I20260811 10:05:03.510365 26283 ts_tablet_manager.cc:1939] T 77e8eac35f4b494e8fef701177a28afe P b8c854a7d570489f86817cf539dc6624: Deleting consensus metadata
I20260811 10:05:03.510829 25733 catalog_manager.cc:4841] TS b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917): tablet 77e8eac35f4b494e8fef701177a28afe (table test-table [id=b154171cd9a04517addda09a54c9267b]) successfully deleted
W20260811 10:05:03.518419 25734 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:44223 (error 108)
I20260811 10:05:03.518637 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 25961
I20260811 10:05:03.519379 26256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.518820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:44223 (local address 127.0.0.1:57088)
0811 10:05:03.519288 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.519340 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:44223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447}
W20260811 10:05:03.522251 25734 catalog_manager.cc:4584] TS f5155a72ad9f496ab8dd129961635e36 (127.9.127.193:44223): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77e8eac35f4b494e8fef701177a28afe: Network error: Client connection negotiation failed: client connection to 127.9.127.193:44223: connect: Connection refused (error 111)
I20260811 10:05:03.530256 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 26107
I20260811 10:05:03.536406 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 25712
I20260811 10:05:03.544075 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:43665
--webserver_interface=127.9.127.254
--webserver_port=44301
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:43665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:03.629412 26286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:03.629664 26286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:03.629701 26286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:03.630888 26286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:05:03.630988 26286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:03.631017 26286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:03.631072 26286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:05:03.631105 26286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:05:03.632601 26286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:43665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:43665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=44301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:03.632906 26286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:03.633137 26286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:03.638087 26291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:03.638159 26294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:03.638218 26292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:03.638300 26286 server_base.cc:1034] running on GCE node
I20260811 10:05:03.638507 26286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:03.638747 26286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:03.639957 26286 hybrid_clock.cc:648] HybridClock initialized: now 1786442703639934 us; error 37 us; skew 500 ppm
Aug 11 10:05:03 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442703, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:03.642647 26286 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:05:03.643110 26286 webserver.cc:460] Webserver started at http://127.9.127.254:44301/ using document root <none> and password file <none>
I20260811 10:05:03.643366 26286 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:03.643446 26286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:03.644867 26286 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 10:05:03.645577 26302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:03.645750 26286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:03.645848 26286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6398a803c3a24508b8192b2ef7d8e1c0"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "b58c8fe8b2c29214a0900590a7862369"
server_key_iv: "65dae8b19ccd1fe4a54ff793bbb38424"
server_key_version: "encryptionkey@0"
I20260811 10:05:03.646229 26286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:03.662117 26286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:03.664012 26286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:03.664181 26286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:03.668294 26286 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:43665
I20260811 10:05:03.668334 26363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:43665 every 8 connection(s)
I20260811 10:05:03.668737 26286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:05:03.669634 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 26286
I20260811 10:05:03.669948 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:44223
--local_ip_for_outbound_sockets=127.9.127.193
--tserver_master_addrs=127.9.127.254:43665
--webserver_port=35985
--webserver_interface=127.9.127.193
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:05:03.670538 26364 sys_catalog.cc:263] Verifying existing consensus state
I20260811 10:05:03.671208 26364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Bootstrap starting.
I20260811 10:05:03.681005 26364 log.cc:824] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:03.683305 26364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:05:03.683630 26364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0: Bootstrap complete.
I20260811 10:05:03.686038 26364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:03.686311 26364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6398a803c3a24508b8192b2ef7d8e1c0, State: Initialized, Role: FOLLOWER
I20260811 10:05:03.686513 26364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:03.686612 26364 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:05:03.686667 26364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:05:03.686715 26364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 10:05:03.687726 26364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:03.687846 26364 leader_election.cc:302] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6398a803c3a24508b8192b2ef7d8e1c0; no voters:
I20260811 10:05:03.688054 26364 leader_election.cc:288] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 10:05:03.688094 26368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 10:05:03.688218 26368 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [term 3 LEADER]: Becoming Leader. State: Replica: 6398a803c3a24508b8192b2ef7d8e1c0, State: Running, Role: LEADER
I20260811 10:05:03.688320 26368 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } }
I20260811 10:05:03.688359 26364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:05:03.688591 26370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6398a803c3a24508b8192b2ef7d8e1c0. Latest consensus state: current_term: 3 leader_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } } }
I20260811 10:05:03.688824 26370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:03.688745 26369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6398a803c3a24508b8192b2ef7d8e1c0" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 43665 } } }
I20260811 10:05:03.689110 26369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6398a803c3a24508b8192b2ef7d8e1c0 [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:03.689260 26377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:05:03.690078 26377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:05:03.690193 26377 catalog_manager.cc:1259] Loaded cluster ID: 823a54ae68bf40d1b7586ebecce55e45
I20260811 10:05:03.690340 26377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 10:05:03.690819 26377 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f7ffc61f9ad google::LogMessage::Fail() at ??:0
@ 0x7f7ffc62288a google::LogMessage::SendToLog() at ??:0
@ 0x7f7ffc61f4de google::LogMessage::Flush() at ??:0
@ 0x7f7ffc620a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f80045440f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f800454d8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f7ffe4ed0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f7ffe4e2954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f7fff3466db start_thread at ??:0
@ 0x7f7ffb11d61f clone at ??:0
W20260811 10:05:03.782759 26366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:03.783056 26366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:03.783097 26366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:03.784931 26366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:03.784992 26366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:03.785038 26366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:05:03.787421 26366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:44223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=35985
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:03.787679 26366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:03.787935 26366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:03.794835 26407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:03.794832 26404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:03.795090 26405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:03.795871 26366 server_base.cc:1034] running on GCE node
I20260811 10:05:03.796130 26366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:03.796458 26366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:03.797628 26366 hybrid_clock.cc:648] HybridClock initialized: now 1786442703797608 us; error 31 us; skew 500 ppm
Aug 11 10:05:03 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442703, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:03.801003 26366 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:05:03.801604 26366 webserver.cc:460] Webserver started at http://127.9.127.193:35985/ using document root <none> and password file <none>
I20260811 10:05:03.801909 26366 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:03.801973 26366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:03.803885 26366 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:05:03.804704 26415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:03.804921 26366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:03.805018 26366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "f5155a72ad9f496ab8dd129961635e36"
format_stamp: "Formatted at 2026-08-11 10:05:01 on dist-test-slave-1x4g"
server_key: "1e2a1d6bd9cfd6c9de61fe924f2b687f"
server_key_iv: "1e2d3b2f8d45cc343038ed3fd1381ddc"
server_key_version: "encryptionkey@0"
I20260811 10:05:03.805437 26366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:03.820436 26366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:03.822840 26366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:03.822988 26366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:03.823267 26366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:03.823743 26422 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 10:05:03.825848 26366 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 10:05:03.825918 26366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 10:05:03.825963 26366 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 10:05:03.826649 26366 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 10:05:03.826714 26366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 10:05:03.826809 26422 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Bootstrap starting.
I20260811 10:05:03.834563 26366 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:44223
I20260811 10:05:03.835093 26366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:05:03.835614 26537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:44223 every 8 connection(s)
I20260811 10:05:03.836902 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 26366
I20260811 10:05:03.837224 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:34387
--local_ip_for_outbound_sockets=127.9.127.194
--tserver_master_addrs=127.9.127.254:43665
--webserver_port=41867
--webserver_interface=127.9.127.194
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:05:03.840155 26422 log.cc:824] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:03.843343 26422 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:05:03.843704 26422 tablet_bootstrap.cc:492] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Bootstrap complete.
I20260811 10:05:03.845201 26422 ts_tablet_manager.cc:1397] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.010s
I20260811 10:05:03.847110 26422 raft_consensus.cc:348] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.847524 26422 raft_consensus.cc:729] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5155a72ad9f496ab8dd129961635e36, State: Initialized, Role: FOLLOWER
I20260811 10:05:03.847736 26422 consensus_queue.cc:260] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:03.848096 26422 ts_tablet_manager.cc:1428] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
W20260811 10:05:03.899814 26541 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:05:03.835924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:47161)
0811 10:05:03.836126 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.836170 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:03.837023 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:03.899610 (+ 62587us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":117,"threads_started":1}
W20260811 10:05:03.900092 26538 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:43665 (0 consecutive failures): Network error: Failed to ping master at 127.9.127.254:43665: Client connection negotiation failed: client connection to 127.9.127.254:43665: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 10:05:03.900502 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.900378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:55377)
0811 10:05:03.900438 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.900481 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 10:05:03.900916 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.900761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:39593)
0811 10:05:03.900857 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.900894 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260811 10:05:03.901068 26538 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 10:05:03.924865 26543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:03.925097 26543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:03.925138 26543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:03.926425 26543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:03.926496 26543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:03.926541 26543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:05:03.928126 26543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:34387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=41867
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:03.928407 26543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:03.928644 26543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:03.933696 26551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:03.933692 26553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:03.933804 26543 server_base.cc:1034] running on GCE node
W20260811 10:05:03.933758 26550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:03.934132 26543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:03.934393 26543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:03.935562 26543 hybrid_clock.cc:648] HybridClock initialized: now 1786442703935543 us; error 39 us; skew 500 ppm
Aug 11 10:05:03 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442703, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:03.938604 26543 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:05:03.938980 26543 webserver.cc:460] Webserver started at http://127.9.127.194:41867/ using document root <none> and password file <none>
I20260811 10:05:03.939162 26543 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:03.939203 26543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:03.940387 26543 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:03.940956 26561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:03.941143 26543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:03.941213 26543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "8921ea8426be4c20b5e2a2abdec5a586"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "e22de43c51ca23933075590ececf7bb7"
server_key_iv: "9eba56d5d007b1e516130cf8c9e012df"
server_key_version: "encryptionkey@0"
I20260811 10:05:03.941524 26543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:03.965890 26543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:03.967648 26543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:03.967754 26543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:03.967924 26543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:03.968245 26543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:03.968297 26543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:03.968320 26543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:03.968374 26543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:03.974026 26543 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:34387
I20260811 10:05:03.974135 26684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:34387 every 8 connection(s)
I20260811 10:05:03.974464 26543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:05:03.975531 26687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.975161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:37071)
0811 10:05:03.975319 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.975386 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
W20260811 10:05:03.975963 26685 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:43665 (0 consecutive failures): Network error: Failed to ping master at 127.9.127.254:43665: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
I20260811 10:05:03.976257 26687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.976164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:37449)
0811 10:05:03.976210 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.976235 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 10:05:03.976526 26687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:03.976442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:55977)
0811 10:05:03.976485 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:03.976507 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 10:05:03.976632 26685 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 10:05:03.984678 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 26543
I20260811 10:05:03.984989 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:40917
--local_ip_for_outbound_sockets=127.9.127.195
--tserver_master_addrs=127.9.127.254:43665
--webserver_port=35569
--webserver_interface=127.9.127.195
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:04.067498 26688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:04.067684 26688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:04.067706 26688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:04.068768 26688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:04.068868 26688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:04.068897 26688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:05:04.070267 26688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:40917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=35569
--tserver_master_addrs=127.9.127.254:43665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:04.070444 26688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:04.070605 26688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:04.075414 26697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:04.075475 26688 server_base.cc:1034] running on GCE node
W20260811 10:05:04.075421 26695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:04.075438 26693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:04.075811 26688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:04.076056 26688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:04.077234 26688 hybrid_clock.cc:648] HybridClock initialized: now 1786442704077228 us; error 36 us; skew 500 ppm
Aug 11 10:05:04 dist-test-slave-1x4g krb5kdc[25100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442704, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:04.079713 26688 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:05:04.080082 26688 webserver.cc:460] Webserver started at http://127.9.127.195:35569/ using document root <none> and password file <none>
I20260811 10:05:04.080283 26688 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:04.080353 26688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:04.081688 26688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:04.082250 26705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:04.082419 26688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:04.082508 26688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "b8c854a7d570489f86817cf539dc6624"
format_stamp: "Formatted at 2026-08-11 10:05:02 on dist-test-slave-1x4g"
server_key: "b3ebf75b659aa290f0cf0404d9205143"
server_key_iv: "fa6e975de423082d8b27a01ab7634625"
server_key_version: "encryptionkey@0"
I20260811 10:05:04.082814 26688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:04.103168 26688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:04.105082 26688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:04.105195 26688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:04.105381 26688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:04.105836 26688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:04.105882 26688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:04.105954 26688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:04.105988 26688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:04.112149 26688 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:40917
I20260811 10:05:04.112275 26826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:40917 every 8 connection(s)
I20260811 10:05:04.112576 26688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:05:04.113692 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:04.113328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:43303)
0811 10:05:04.113479 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:04.113553 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
W20260811 10:05:04.114132 26827 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:43665 (0 consecutive failures): Network error: Failed to ping master at 127.9.127.254:43665: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
I20260811 10:05:04.114431 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:04.114335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:46153)
0811 10:05:04.114388 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:04.114415 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 10:05:04.114794 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:04.114716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:60637)
0811 10:05:04.114759 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:04.114780 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 10:05:04.114943 26827 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 10:05:04.121001 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 26688
I20260811 10:05:04.901636 26832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:04.901398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:43687)
0811 10:05:04.901531 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:04.901564 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
I20260811 10:05:04.977241 26833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:04.977002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:58691)
0811 10:05:04.977147 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:04.977186 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":60,"threads_started":1}
I20260811 10:05:05.115551 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:05.115248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:59657)
0811 10:05:05.115455 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:05.115493 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":56,"threads_started":1}
I20260811 10:05:05.181775 26835 raft_consensus.cc:482] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:05.181903 26835 raft_consensus.cc:504] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:05.182332 26835 leader_election.cc:288] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917), 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387)
Aug 11 10:05:05 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442703, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.194@KRBTEST.COM
Aug 11 10:05:05 dist-test-slave-1x4g krb5kdc[25100](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442703, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.195@KRBTEST.COM
I20260811 10:05:05.193722 26837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:05.182624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:33195 (local address 127.9.127.195:40917)
0811 10:05:05.182776 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:05.182789 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:05.182826 (+ 37us) server_negotiation.cc:407] Connection header received
0811 10:05:05.183293 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:05.183295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:05.183337 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:05.183505 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:05.184264 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:05.185205 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:05.186728 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:05.187166 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:05.187320 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:05.190203 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:05.190207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:05.190207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:05.190224 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:05.192018 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:05.192417 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:05.192419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:05.192419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:05.192557 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:05.192829 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:05.192830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:05.192830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:05.193069 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:05.193179 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:05.193451 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 10:05:05.193600 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":54,"threads_started":1}
I20260811 10:05:05.193707 26836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:05.182520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:34387 (local address 127.9.127.193:48107)
0811 10:05:05.182668 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:05.182678 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:05.182734 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:05.183540 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:05.183542 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:05.183921 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:05.184134 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:05.184140 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:05.185355 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:05.185356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:05.186637 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:05.186640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:05.187288 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:05.187289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:05.187409 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:05.188063 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:05.188068 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:05.189713 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:05.191895 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:05.191903 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:05.191906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:05.192222 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:05.192512 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:05.192513 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:05.192513 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:05.192652 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:05.193139 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:05.193146 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:05.193275 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 10:05:05.193392 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 10:05:05.193604 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":95,"thread_start_us":86,"threads_started":1}
I20260811 10:05:05.193725 26838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:05.182690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:48107 (local address 127.9.127.194:34387)
0811 10:05:05.182840 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:05.182849 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:05.182878 (+ 29us) server_negotiation.cc:407] Connection header received
0811 10:05:05.183319 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:05.183321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:05.183357 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:05.183507 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:05.184264 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:05.185221 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:05.186768 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:05.187182 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:05.187320 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:05.189833 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:05.189855 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:05.189856 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:05.189869 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:05.191801 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:05.192310 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:05.192314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:05.192314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:05.192434 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:05.192725 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:05.192726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:05.192726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:05.193050 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:05.193117 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:05.193449 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 10:05:05.193587 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":72,"threads_started":1}
I20260811 10:05:05.193836 26832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:05.182497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:40917 (local address 127.9.127.193:33195)
0811 10:05:05.182555 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:05.182570 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:05.182632 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:05.183539 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:05.183542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:05.183920 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:05.184134 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:05.184140 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:05.185347 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:05.185349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:05.186637 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:05.186640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:05.187285 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:05.187286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:05.187411 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:05.188032 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:05.188041 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:05.190089 (+ 2048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:05.192105 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:05.192105 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:05.192106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:05.192333 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:05.192641 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:05.192642 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:05.192642 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:05.192736 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:05.193174 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:05.193175 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:05.193275 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 10:05:05.193392 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 10:05:05.193692 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":187}
W20260811 10:05:05.194762 26418 leader_election.cc:341] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917): Not found: Tablet not found: 77e8eac35f4b494e8fef701177a28afe
W20260811 10:05:05.195312 26417 leader_election.cc:341] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387): Not found: Tablet not found: 77e8eac35f4b494e8fef701177a28afe
I20260811 10:05:05.195362 26417 leader_election.cc:302] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5155a72ad9f496ab8dd129961635e36; no voters: 8921ea8426be4c20b5e2a2abdec5a586, b8c854a7d570489f86817cf539dc6624
I20260811 10:05:05.195526 26835 raft_consensus.cc:2726] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:05:05.902360 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:05.902112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:53967)
0811 10:05:05.902274 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:05.902314 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":73,"threads_started":1}
I20260811 10:05:05.977892 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:05.977686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:35265)
0811 10:05:05.977813 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:05.977847 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
I20260811 10:05:06.116271 26841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:06.116082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:34431)
0811 10:05:06.116200 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:06.116235 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260811 10:05:06.903052 26842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:06.902820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:58329)
0811 10:05:06.902973 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:06.903006 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260811 10:05:06.978626 26843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:06.978323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:49673)
0811 10:05:06.978537 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:06.978575 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":60,"threads_started":1}
I20260811 10:05:07.070518 26844 raft_consensus.cc:482] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:07.070603 26844 raft_consensus.cc:504] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:07.070770 26844 leader_election.cc:288] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917), 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387)
W20260811 10:05:07.071148 26417 leader_election.cc:341] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387): Not found: Tablet not found: 77e8eac35f4b494e8fef701177a28afe
W20260811 10:05:07.071223 26418 leader_election.cc:341] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917): Not found: Tablet not found: 77e8eac35f4b494e8fef701177a28afe
I20260811 10:05:07.071282 26418 leader_election.cc:302] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5155a72ad9f496ab8dd129961635e36; no voters: 8921ea8426be4c20b5e2a2abdec5a586, b8c854a7d570489f86817cf539dc6624
I20260811 10:05:07.071358 26844 raft_consensus.cc:2726] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:05:07.116895 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:07.116701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:56865)
0811 10:05:07.116829 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:07.116861 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":59,"threads_started":1}
I20260811 10:05:07.903877 26847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:07.903566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:43487)
0811 10:05:07.903796 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:07.903831 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":76,"threads_started":1}
I20260811 10:05:07.979275 26848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:07.979090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:55295)
0811 10:05:07.979208 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:07.979242 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260811 10:05:08.117518 26851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:08.117313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:33419)
0811 10:05:08.117448 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:08.117483 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260811 10:05:08.603089 26852 raft_consensus.cc:482] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:08.603178 26852 raft_consensus.cc:504] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:08.603384 26852 leader_election.cc:288] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917), 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387)
W20260811 10:05:08.603785 26418 leader_election.cc:341] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917): Not found: Tablet not found: 77e8eac35f4b494e8fef701177a28afe
W20260811 10:05:08.603874 26417 leader_election.cc:341] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387): Not found: Tablet not found: 77e8eac35f4b494e8fef701177a28afe
I20260811 10:05:08.603969 26417 leader_election.cc:302] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5155a72ad9f496ab8dd129961635e36; no voters: 8921ea8426be4c20b5e2a2abdec5a586, b8c854a7d570489f86817cf539dc6624
I20260811 10:05:08.604067 26852 raft_consensus.cc:2726] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:05:08.904637 26854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:08.904382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:43041)
0811 10:05:08.904547 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:08.904588 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":65,"threads_started":1}
I20260811 10:05:08.979905 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:08.979708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:46217)
0811 10:05:08.979837 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:08.979867 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260811 10:05:09.118124 26858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:09.117930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:51505)
0811 10:05:09.118048 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:09.118088 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":65,"threads_started":1}
I20260811 10:05:09.905333 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:09.905112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:58543)
0811 10:05:09.905250 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:09.905285 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260811 10:05:09.980568 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:09.980361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:37039)
0811 10:05:09.980496 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:09.980530 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260811 10:05:10.118815 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:10.118606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:42723)
0811 10:05:10.118743 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:10.118775 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260811 10:05:10.905992 26862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:10.905766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:42565)
0811 10:05:10.905908 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:10.905944 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260811 10:05:10.981171 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:10.980969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:33657)
0811 10:05:10.981099 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:10.981135 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260811 10:05:11.119545 26864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:11.119359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:49345)
0811 10:05:11.119474 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:11.119507 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260811 10:05:11.906625 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:11.906402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:47755)
0811 10:05:11.906526 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:11.906556 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260811 10:05:11.981819 26866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:11.981633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:55991)
0811 10:05:11.981748 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:11.981782 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260811 10:05:12.120200 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:12.119994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:51669)
0811 10:05:12.120131 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:12.120162 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260811 10:05:12.907270 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:12.907042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:49331)
0811 10:05:12.907170 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:12.907205 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260811 10:05:12.982470 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:12.982261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:47415)
0811 10:05:12.982387 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:12.982426 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260811 10:05:13.121088 26870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:13.120857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:56351)
0811 10:05:13.121002 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:13.121043 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260811 10:05:13.165373 26871 raft_consensus.cc:482] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:13.165491 26871 raft_consensus.cc:504] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c854a7d570489f86817cf539dc6624" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 40917 } } peers { permanent_uuid: "8921ea8426be4c20b5e2a2abdec5a586" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34387 } } peers { permanent_uuid: "f5155a72ad9f496ab8dd129961635e36" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44223 } }
I20260811 10:05:13.165661 26871 leader_election.cc:288] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917), 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387)
W20260811 10:05:13.166056 26417 leader_election.cc:341] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8921ea8426be4c20b5e2a2abdec5a586 (127.9.127.194:34387): Not found: Tablet not found: 77e8eac35f4b494e8fef701177a28afe
W20260811 10:05:13.166138 26418 leader_election.cc:341] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8c854a7d570489f86817cf539dc6624 (127.9.127.195:40917): Not found: Tablet not found: 77e8eac35f4b494e8fef701177a28afe
I20260811 10:05:13.166229 26418 leader_election.cc:302] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5155a72ad9f496ab8dd129961635e36; no voters: 8921ea8426be4c20b5e2a2abdec5a586, b8c854a7d570489f86817cf539dc6624
I20260811 10:05:13.166322 26871 raft_consensus.cc:2726] T 77e8eac35f4b494e8fef701177a28afe P f5155a72ad9f496ab8dd129961635e36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:05:13.907963 26872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:13.907750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:43803)
0811 10:05:13.907878 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:13.907915 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260811 10:05:13.983167 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:13.982943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:44339)
0811 10:05:13.983079 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:13.983130 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260811 10:05:14.121712 26874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:14.121502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:47265)
0811 10:05:14.121635 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:14.121670 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":57,"threads_started":1}
I20260811 10:05:14.908756 26876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:14.908523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:45293)
0811 10:05:14.908658 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:14.908693 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260811 10:05:14.983934 26877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:14.983747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:40319)
0811 10:05:14.983866 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:14.983899 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260811 10:05:15.122380 26878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:15.122185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:50757)
0811 10:05:15.122307 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:15.122343 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260811 10:05:15.909466 26879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:15.909236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:37815)
0811 10:05:15.909388 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:15.909419 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260811 10:05:15.984580 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:15.984365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:50399)
0811 10:05:15.984504 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:15.984537 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260811 10:05:16.123099 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:16.122837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:60723)
0811 10:05:16.122994 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:16.123035 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":60,"threads_started":1}
I20260811 10:05:16.910147 26882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:16.909906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:42733)
0811 10:05:16.910059 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:16.910099 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":63,"threads_started":1}
I20260811 10:05:16.985361 26883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:16.985149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:33307)
0811 10:05:16.985273 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:16.985316 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260811 10:05:17.123739 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:17.123533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:51175)
0811 10:05:17.123660 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:17.123696 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260811 10:05:17.910969 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:17.910757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:58649)
0811 10:05:17.910880 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:17.910915 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260811 10:05:17.986066 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:17.985826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:40943)
0811 10:05:17.985989 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:17.986023 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":64,"threads_started":1}
I20260811 10:05:18.124442 26887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:18.124221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:59387)
0811 10:05:18.124361 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:18.124396 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260811 10:05:18.911821 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:18.911510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.193:34945)
0811 10:05:18.911663 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:18.911755 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":64,"threads_started":1}
I20260811 10:05:18.986877 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:18.986659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.194:33213)
0811 10:05:18.986798 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:18.986834 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260811 10:05:19.122095 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 26366
I20260811 10:05:19.129068 26890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:19.128840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:43665 (local address 127.9.127.195:47497)
0811 10:05:19.128991 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:19.129026 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:43665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":58,"threads_started":1}
I20260811 10:05:19.133889 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 26543
I20260811 10:05:19.140125 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 26688
2026-08-11T10:05:19Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18834 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:05:19 dist-test-slave-1x4g krb5kdc[26893](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:05:19 dist-test-slave-1x4g krb5kdc[26893](info): set up 2 sockets
Aug 11 10:05:19 dist-test-slave-1x4g krb5kdc[26893](info): commencing operation
krb5kdc: starting...
W20260811 10:05:20.231626 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:05:20 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:05:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:05:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:05:20.356248 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33125
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:33125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:20.438236 26906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:20.438416 26906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:20.438436 26906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:20.439443 26906 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 10:05:20.439474 26906 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 10:05:20.439486 26906 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 10:05:20.439497 26906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:05:20.439510 26906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:20.439522 26906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:20.439534 26906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:05:20.439550 26906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:05:20.440994 26906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:33125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:20.441165 26906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:20.441316 26906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:20.445978 26915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:20.446002 26913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:20.446133 26912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:20.446264 26906 server_base.cc:1034] running on GCE node
I20260811 10:05:20.446502 26906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:20.446780 26906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:20.447956 26906 hybrid_clock.cc:648] HybridClock initialized: now 1786442720447949 us; error 30 us; skew 500 ppm
Aug 11 10:05:20 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:20.450609 26906 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:05:20.451082 26906 webserver.cc:460] Webserver started at http://127.9.127.254:45581/ using document root <none> and password file <none>
I20260811 10:05:20.451340 26906 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:20.451428 26906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:20.451568 26906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:20.452612 26906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "56aa245b0d3545a8a90920160a9ca38e"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "248720ae5bd06592830279d1bdcb73f8"
server_key_iv: "5a57098f76b14909b4322f89a0742e76"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.452992 26906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "56aa245b0d3545a8a90920160a9ca38e"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "248720ae5bd06592830279d1bdcb73f8"
server_key_iv: "5a57098f76b14909b4322f89a0742e76"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.454298 26906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:20.455004 26924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.455184 26906 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:05:20.455294 26906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "56aa245b0d3545a8a90920160a9ca38e"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "248720ae5bd06592830279d1bdcb73f8"
server_key_iv: "5a57098f76b14909b4322f89a0742e76"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.455363 26906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:20.466473 26906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:20.468111 26906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:20.468261 26906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:20.472330 26906 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:33125
I20260811 10:05:20.472362 26979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:33125 every 8 connection(s)
I20260811 10:05:20.472725 26906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:05:20.473610 26980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:20.475720 26980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Bootstrap starting.
I20260811 10:05:20.476253 26980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:20.476490 26980 log.cc:824] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:20.477121 26980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: No bootstrap required, opened a new log
I20260811 10:05:20.478628 26980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:05:20.478757 26980 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:20.478780 26980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56aa245b0d3545a8a90920160a9ca38e, State: Initialized, Role: FOLLOWER
I20260811 10:05:20.478876 26980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:05:20.478945 26980 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:05:20.478966 26980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:05:20.479059 26980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:20.479562 26980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:05:20.479683 26980 leader_election.cc:302] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56aa245b0d3545a8a90920160a9ca38e; no voters:
I20260811 10:05:20.479871 26980 leader_election.cc:288] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:05:20.479945 26983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:05:20.480118 26980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:05:20.480120 26983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 1 LEADER]: Becoming Leader. State: Replica: 56aa245b0d3545a8a90920160a9ca38e, State: Running, Role: LEADER
I20260811 10:05:20.480310 26983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:05:20.480681 26984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56aa245b0d3545a8a90920160a9ca38e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } } }
I20260811 10:05:20.480705 26985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56aa245b0d3545a8a90920160a9ca38e. Latest consensus state: current_term: 1 leader_uuid: "56aa245b0d3545a8a90920160a9ca38e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } } }
I20260811 10:05:20.480876 26985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:20.481099 26994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:05:20.481294 26984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:20.481436 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 26906
I20260811 10:05:20.481531 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:05:20.481756 9727 external_mini_cluster.cc:1428] Setting key 0ead0a8471fa4fb8a92853fb97e159d2
I20260811 10:05:20.482352 26994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:05:20.483850 26994 catalog_manager.cc:1347] Generated new cluster ID: 6cb955e980c4420186a2be7a35575c87
I20260811 10:05:20.483899 26994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:05:20 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:20.494524 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:20.482212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32930 (local address 127.9.127.254:33125)
0811 10:05:20.482564 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:20.482583 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:20.482616 (+ 33us) server_negotiation.cc:407] Connection header received
0811 10:05:20.482926 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:20.482933 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:20.482988 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:20.483962 (+ 974us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:20.484061 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.485485 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.486649 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.487301 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.487721 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:20.490343 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:20.490347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:20.490348 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:20.490362 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:20.492400 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:20.492855 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:20.492858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:20.492859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:20.492964 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:20.493192 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:20.493193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:20.493193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:20.493508 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:20.494103 (+ 595us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:20.494177 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 10:05:20.494312 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":81,"threads_started":1}
I20260811 10:05:20.515110 26994 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:05:20.515642 26994 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:05:20.519774 26994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Generated new TSK 0
I20260811 10:05:20.519950 26994 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:05:20.554023 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33125
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:20.636382 27009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:20.636575 27009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:20.636598 27009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:20.637837 27009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:20.637879 27009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:20.637930 27009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:05:20.639355 27009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:20.639600 27009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:20.639829 27009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:20.644991 27018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:20.645124 27009 server_base.cc:1034] running on GCE node
W20260811 10:05:20.645018 27020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:20.645026 27016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:20.645423 27009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:20.645713 27009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:20.646883 27009 hybrid_clock.cc:648] HybridClock initialized: now 1786442720646877 us; error 32 us; skew 500 ppm
Aug 11 10:05:20 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:20.649685 27009 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:05:20.650125 27009 webserver.cc:460] Webserver started at http://127.9.127.193:38725/ using document root <none> and password file <none>
I20260811 10:05:20.650353 27009 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:20.650419 27009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:20.650570 27009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:20.651604 27009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "381f7ab52d079e0e7b1ff514d339a7d6"
server_key_iv: "d5c27d4802ddf2ab5db50cc0d3d4377d"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.651970 27009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "381f7ab52d079e0e7b1ff514d339a7d6"
server_key_iv: "d5c27d4802ddf2ab5db50cc0d3d4377d"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.653395 27009 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 10:05:20.654150 27027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.654321 27009 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:20.654428 27009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "381f7ab52d079e0e7b1ff514d339a7d6"
server_key_iv: "d5c27d4802ddf2ab5db50cc0d3d4377d"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.654500 27009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:20.670871 27009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:20.673240 27009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:20.673406 27009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:20.673705 27009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:20.674099 27009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:20.674160 27009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.674194 27009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:20.674239 27009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.682958 27009 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:36225
I20260811 10:05:20.683004 27148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:36225 every 8 connection(s)
I20260811 10:05:20.683374 27009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:05:20.689638 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 27009
I20260811 10:05:20.689728 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:05:20.689962 9727 external_mini_cluster.cc:1428] Setting key 1235509f072db4245135df3ef9138dfc
Aug 11 10:05:20 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:20.693616 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:20.684652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:41649)
0811 10:05:20.684843 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:20.684894 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:20.685458 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:20.685714 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:20.685717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:20.686305 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:20.686496 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:20.686502 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.687189 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.687190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:20.687949 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:20.687951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.688322 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.688323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:20.688425 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:20.688947 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:20.688955 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:20.690442 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:20.692105 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:20.692112 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:20.692114 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:20.692452 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:20.692694 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:20.692694 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:20.692694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:20.692852 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:20.693147 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:20.693153 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:20.693266 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 10:05:20.693342 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 10:05:20.693460 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
I20260811 10:05:20.693634 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:20.684680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:41649 (local address 127.9.127.254:33125)
0811 10:05:20.684725 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:20.684727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:20.685015 (+ 288us) server_negotiation.cc:407] Connection header received
0811 10:05:20.685577 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:20.685578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:20.685594 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:20.685660 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:20.686591 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.687106 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.688025 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.688243 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.688297 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:20.690530 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:20.690531 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:20.690532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:20.690542 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:20.692014 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:20.692551 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:20.692552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:20.692553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:20.692622 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:20.692924 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:20.692925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:20.692926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:20.693077 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:20.693153 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:20.693406 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 10:05:20.693515 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:05:20.694118 27149 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33125
I20260811 10:05:20.694243 27149 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:20.694417 27149 heartbeater.cc:511] Master 127.9.127.254:33125 requested a full tablet report, sending...
I20260811 10:05:20.694991 26943 ts_manager.cc:194] Registered new tserver with Master: 77d2cc5f45b44d6abec7b4ebcb6637fa (127.9.127.193:36225)
I20260811 10:05:20.696064 26943 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:41649
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:05:20.717136 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33125
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:20.798580 27155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:20.798820 27155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:20.798859 27155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:20.799993 27155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:20.800060 27155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:20.800118 27155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:05:20.801661 27155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:20.801920 27155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:20.802170 27155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:20.807345 27162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:20.807420 27155 server_base.cc:1034] running on GCE node
W20260811 10:05:20.807368 27164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:20.807355 27161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:20.807796 27155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:20.808077 27155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:20.809252 27155 hybrid_clock.cc:648] HybridClock initialized: now 1786442720809244 us; error 39 us; skew 500 ppm
Aug 11 10:05:20 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:20.811918 27155 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:05:20.812350 27155 webserver.cc:460] Webserver started at http://127.9.127.194:42427/ using document root <none> and password file <none>
I20260811 10:05:20.812582 27155 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:20.812651 27155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:20.812863 27155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:20.813934 27155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "44d31476c9874fdd9827a0452e9ade31"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "a82ad3c2f823d090b5f2bef4e03c5459"
server_key_iv: "f1898fdbb2ebf72798c106e732639b0f"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.814319 27155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "44d31476c9874fdd9827a0452e9ade31"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "a82ad3c2f823d090b5f2bef4e03c5459"
server_key_iv: "f1898fdbb2ebf72798c106e732639b0f"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.815637 27155 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:05:20.816399 27172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.816592 27155 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:20.816716 27155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "44d31476c9874fdd9827a0452e9ade31"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "a82ad3c2f823d090b5f2bef4e03c5459"
server_key_iv: "f1898fdbb2ebf72798c106e732639b0f"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.816823 27155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:20.825279 27155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:20.827827 27155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:20.827982 27155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:20.828238 27155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:20.828691 27155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:20.828743 27155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.828806 27155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:20.828840 27155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.836879 27155 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:39495
I20260811 10:05:20.836943 27294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:39495 every 8 connection(s)
I20260811 10:05:20.837374 27155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:05:20.842221 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 27155
I20260811 10:05:20.842347 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:05:20.842578 9727 external_mini_cluster.cc:1428] Setting key 8200f9e8d209faba9fd894deca167e73
Aug 11 10:05:20 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:20.847564 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:20.838140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:51473 (local address 127.9.127.254:33125)
0811 10:05:20.838225 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:20.838227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:20.838396 (+ 169us) server_negotiation.cc:407] Connection header received
0811 10:05:20.839376 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:20.839376 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:20.839388 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:20.839445 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:20.840017 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.840500 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.841562 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.841756 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.841814 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:20.844586 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:20.844588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:20.844589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:20.844595 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:20.846034 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:20.846564 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:20.846565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:20.846565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:20.846630 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:20.846887 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:20.846888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:20.846888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:20.847037 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:20.847122 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:20.847335 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 10:05:20.847428 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 10:05:20.847575 27297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:20.838095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:51473)
0811 10:05:20.838255 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:20.838291 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:20.839279 (+ 988us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:20.839499 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:20.839502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:20.839758 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:20.839942 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:20.839946 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.840590 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.840591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:20.841484 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:20.841487 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:20.841835 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:20.841835 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:20.841932 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:20.842460 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:20.842473 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:20.844471 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:20.846119 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:20.846127 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:20.846129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:20.846464 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:20.846700 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:20.846701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:20.846701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:20.846814 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:20.847108 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:20.847111 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:20.847214 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 10:05:20.847288 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 10:05:20.847418 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":99,"threads_started":1}
I20260811 10:05:20.848121 27295 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33125
I20260811 10:05:20.848233 27295 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:20.848426 27295 heartbeater.cc:511] Master 127.9.127.254:33125 requested a full tablet report, sending...
I20260811 10:05:20.848835 26943 ts_manager.cc:194] Registered new tserver with Master: 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495)
I20260811 10:05:20.849336 26943 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:51473
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:05:20.871351 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33125
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:20.956101 27301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:20.956295 27301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:20.956316 27301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:20.957890 27301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:20.957952 27301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:20.958000 27301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:05:20.959664 27301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:20.959900 27301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:20.960141 27301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:20.965042 27308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:20.965071 27311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:20.965054 27309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:20.965498 27301 server_base.cc:1034] running on GCE node
I20260811 10:05:20.965719 27301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:20.965956 27301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:20.967140 27301 hybrid_clock.cc:648] HybridClock initialized: now 1786442720967104 us; error 45 us; skew 500 ppm
Aug 11 10:05:20 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:20.969745 27301 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:05:20.970221 27301 webserver.cc:460] Webserver started at http://127.9.127.195:40487/ using document root <none> and password file <none>
I20260811 10:05:20.970441 27301 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:20.970504 27301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:20.970646 27301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:05:20.971700 27301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "67c65c18b57e4587b51de2c71106a8f1"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "fa7eaa732c13db4bc6d8c47952d176f8"
server_key_iv: "a382198b70201dc41101b1b7a21a3343"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.972074 27301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "67c65c18b57e4587b51de2c71106a8f1"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "fa7eaa732c13db4bc6d8c47952d176f8"
server_key_iv: "a382198b70201dc41101b1b7a21a3343"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.973459 27301 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:05:20.974129 27318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.974287 27301 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:20.974383 27301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "67c65c18b57e4587b51de2c71106a8f1"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "fa7eaa732c13db4bc6d8c47952d176f8"
server_key_iv: "a382198b70201dc41101b1b7a21a3343"
server_key_version: "encryptionkey@0"
I20260811 10:05:20.974450 27301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:20.999828 27301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:21.002133 27301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:21.002314 27301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:21.002556 27301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:21.002862 27301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:21.002912 27301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:21.002952 27301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:21.002987 27301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:21.008751 27301 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:43689
I20260811 10:05:21.008846 27438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:43689 every 8 connection(s)
I20260811 10:05:21.009182 27301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
Aug 11 10:05:21 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442720, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:21.017331 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 27301
I20260811 10:05:21.017432 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:05:21.017642 9727 external_mini_cluster.cc:1428] Setting key d05480590639f161ecf2ee5378fb5cd2
I20260811 10:05:21.018451 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.009884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:44149 (local address 127.9.127.254:33125)
0811 10:05:21.009934 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:21.009936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:21.010134 (+ 198us) server_negotiation.cc:407] Connection header received
0811 10:05:21.010622 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:21.010623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:21.010634 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:21.010678 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:21.011587 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.012070 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.013098 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.013277 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.013324 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.015505 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:21.015507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:21.015507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:21.015515 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:21.016978 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:21.017362 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:21.017363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:21.017363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:21.017428 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:21.017720 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:21.017721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:21.017721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:21.017841 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:21.017920 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:21.018297 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 10:05:21.018389 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 10:05:21.018675 27442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.009844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:44149)
0811 10:05:21.010005 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:21.010047 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:21.010523 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:21.010731 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:21.010735 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:21.011320 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:21.011513 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.011518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.012157 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.012158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.013015 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.013018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.013339 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.013340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.013445 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.013904 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:21.013911 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:21.015376 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:21.017054 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:21.017062 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:21.017064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:21.017284 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:21.017544 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:21.017545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:21.017545 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:21.017654 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:21.017928 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:21.017934 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:21.018112 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 10:05:21.018251 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 10:05:21.018423 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260811 10:05:21.019094 27439 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33125
I20260811 10:05:21.019188 27439 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:21.019379 27439 heartbeater.cc:511] Master 127.9.127.254:33125 requested a full tablet report, sending...
I20260811 10:05:21.019742 26943 ts_manager.cc:194] Registered new tserver with Master: 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689)
I20260811 10:05:21.020108 26943 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:44149
I20260811 10:05:21.029564 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:05:21.036659 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.030939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32932 (local address 127.9.127.254:33125)
0811 10:05:21.031009 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:21.031012 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:21.031116 (+ 104us) server_negotiation.cc:407] Connection header received
0811 10:05:21.031176 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:21.031177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:21.031187 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:21.031230 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:21.031770 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.032272 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.033031 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.033218 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.033287 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.034355 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:21.034357 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:21.034357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:21.034364 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:21.035733 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:21.036019 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:21.036020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:21.036020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:21.036075 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:21.036216 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:21.036216 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:21.036216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:21.036352 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:21.036423 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:21.036501 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 10:05:21.036559 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 10:05:21.038381 26943 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:05:21.039958 26943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:05:21.046327 27456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.042483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:36225 (local address 127.0.0.1:55942)
0811 10:05:21.042779 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:21.042787 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:21.042843 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:21.043082 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:21.043085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:21.043088 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:21.043158 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.043161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.044260 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.044262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.045297 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.045300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.045985 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.045986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.046084 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.046099 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 10:05:21.046197 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 10:05:21.046254 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":77,"threads_started":1}
I20260811 10:05:21.046339 27457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.042643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55942 (local address 127.9.127.193:36225)
0811 10:05:21.042784 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:21.042788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:21.042831 (+ 43us) server_negotiation.cc:407] Connection header received
0811 10:05:21.042962 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:21.042964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:21.042983 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:21.043067 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:21.043243 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.044162 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.045378 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.045896 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.045984 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.046048 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:21.046218 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 10:05:21.046255 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260811 10:05:21.047350 27452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.042261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43689 (local address 127.0.0.1:43740)
0811 10:05:21.042605 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:21.042616 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:21.042658 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:21.043525 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:21.043525 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:21.043527 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:21.043561 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.043562 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.044922 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.044923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.046190 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.046193 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.047115 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.047116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.047180 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.047183 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:05:21.047244 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 10:05:21.047281 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":9,"spinlock_wait_cycles":384,"thread_start_us":86,"threads_started":1}
I20260811 10:05:21.047415 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.042460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43740 (local address 127.9.127.195:43689)
0811 10:05:21.043365 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:21.043369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:21.043379 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:05:21.043417 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:21.043419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:21.043434 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:21.043520 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:21.043639 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.044764 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.046303 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.047028 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.047102 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.047156 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:21.047267 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 10:05:21.047313 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":81,"threads_started":1}
I20260811 10:05:21.047466 27072 tablet_service.cc:1467] Processing CreateTablet for tablet 131afac5faeb4abca95cc2516ab3716a (DEFAULT_TABLE table=test-table [id=de4786f1daae4179861cabdbebda4380]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:21.047813 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.042261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39495 (local address 127.0.0.1:57220)
0811 10:05:21.042436 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:21.042479 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:21.042546 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:21.043602 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:21.043603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:21.043606 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:21.043650 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.043652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.044937 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.044938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.046190 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.046193 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.047194 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.047195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.047605 (+ 410us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.047609 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:21.047692 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 10:05:21.047732 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":72,"thread_start_us":64,"threads_started":1}
I20260811 10:05:21.047852 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.042365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57220 (local address 127.9.127.194:39495)
0811 10:05:21.043027 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:21.043032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:21.043044 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:05:21.043096 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:21.043099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:21.043116 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:21.043209 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:21.043719 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.044845 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.046293 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.047028 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.047101 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.047156 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:21.047712 (+ 556us) server_negotiation.cc:299] Negotiation successful
0811 10:05:21.047770 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":94,"threads_started":1}
I20260811 10:05:21.047923 27072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 131afac5faeb4abca95cc2516ab3716a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:21.048404 27225 tablet_service.cc:1467] Processing CreateTablet for tablet 131afac5faeb4abca95cc2516ab3716a (DEFAULT_TABLE table=test-table [id=de4786f1daae4179861cabdbebda4380]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:21.048401 27369 tablet_service.cc:1467] Processing CreateTablet for tablet 131afac5faeb4abca95cc2516ab3716a (DEFAULT_TABLE table=test-table [id=de4786f1daae4179861cabdbebda4380]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:21.048746 27369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 131afac5faeb4abca95cc2516ab3716a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:21.048801 27225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 131afac5faeb4abca95cc2516ab3716a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:21.050985 27458 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Bootstrap starting.
I20260811 10:05:21.051638 27458 tablet_bootstrap.cc:654] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:21.052121 27460 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: Bootstrap starting.
I20260811 10:05:21.052289 27458 log.cc:824] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:21.052907 27460 tablet_bootstrap.cc:654] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:21.052932 27459 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Bootstrap starting.
I20260811 10:05:21.053184 27458 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: No bootstrap required, opened a new log
I20260811 10:05:21.053275 27458 ts_tablet_manager.cc:1397] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:05:21.053490 27460 log.cc:824] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:21.053565 27459 tablet_bootstrap.cc:654] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:21.054131 27459 log.cc:824] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:21.054303 27460 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: No bootstrap required, opened a new log
I20260811 10:05:21.054384 27460 ts_tablet_manager.cc:1397] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 10:05:21.054852 27459 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: No bootstrap required, opened a new log
I20260811 10:05:21.054936 27459 ts_tablet_manager.cc:1397] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:05:21.055294 27458 raft_consensus.cc:348] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.055480 27458 raft_consensus.cc:374] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:21.055517 27458 raft_consensus.cc:729] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d2cc5f45b44d6abec7b4ebcb6637fa, State: Initialized, Role: FOLLOWER
I20260811 10:05:21.055678 27458 consensus_queue.cc:260] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.056071 27458 ts_tablet_manager.cc:1428] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:05:21.056245 27149 heartbeater.cc:503] Master 127.9.127.254:33125 was elected leader, sending a full tablet report...
I20260811 10:05:21.056404 27460 raft_consensus.cc:348] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.056566 27460 raft_consensus.cc:374] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:21.056599 27460 raft_consensus.cc:729] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67c65c18b57e4587b51de2c71106a8f1, State: Initialized, Role: FOLLOWER
I20260811 10:05:21.056712 27460 consensus_queue.cc:260] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.057003 27460 ts_tablet_manager.cc:1428] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 10:05:21.056984 27459 raft_consensus.cc:348] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.057148 27439 heartbeater.cc:503] Master 127.9.127.254:33125 was elected leader, sending a full tablet report...
I20260811 10:05:21.057161 27459 raft_consensus.cc:374] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:21.057204 27459 raft_consensus.cc:729] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44d31476c9874fdd9827a0452e9ade31, State: Initialized, Role: FOLLOWER
I20260811 10:05:21.057328 27459 consensus_queue.cc:260] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.057637 27459 ts_tablet_manager.cc:1428] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:05:21.057717 27295 heartbeater.cc:503] Master 127.9.127.254:33125 was elected leader, sending a full tablet report...
W20260811 10:05:21.088096 27296 tablet.cc:2369] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:05:21.115398 27465 raft_consensus.cc:482] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:21.115551 27465 raft_consensus.cc:504] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.115947 27465 leader_election.cc:288] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495), 77d2cc5f45b44d6abec7b4ebcb6637fa (127.9.127.193:36225)
I20260811 10:05:21.119253 27442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.116179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39495 (local address 127.9.127.195:47449)
0811 10:05:21.116242 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:21.116256 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:21.116365 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:21.116561 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:21.116562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:21.116564 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:21.116676 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.116698 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.117425 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.117426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.118278 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.118281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.119003 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.119004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.119094 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.119098 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:21.119150 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 10:05:21.119184 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 10:05:21.119292 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.116296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:47449 (local address 127.9.127.194:39495)
0811 10:05:21.116370 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:21.116372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:21.116437 (+ 65us) server_negotiation.cc:407] Connection header received
0811 10:05:21.116472 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:21.116473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:21.116485 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:21.116545 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:21.116814 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.117338 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.118369 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.118902 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.118961 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.118968 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:21.119176 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 10:05:21.119220 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:05:21.119378 27467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.116308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:36225 (local address 127.9.127.195:59347)
0811 10:05:21.116555 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:21.116566 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:21.116648 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:21.116829 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:21.116830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:21.116832 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:21.116930 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.116932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.117640 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.117641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.118466 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:21.118469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.119099 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.119100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:21.119198 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.119202 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:21.119254 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 10:05:21.119289 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":16,"thread_start_us":172,"threads_started":1}
I20260811 10:05:21.119433 27457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.116424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:59347 (local address 127.9.127.193:36225)
0811 10:05:21.116478 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:21.116480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:21.116654 (+ 174us) server_negotiation.cc:407] Connection header received
0811 10:05:21.116716 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:21.116718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:21.116732 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:21.116814 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:21.117008 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.117550 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.118567 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.119005 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.119081 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.119090 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:21.119276 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 10:05:21.119324 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 10:05:21.119733 27100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "131afac5faeb4abca95cc2516ab3716a" candidate_uuid: "67c65c18b57e4587b51de2c71106a8f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" is_pre_election: true
I20260811 10:05:21.119730 27245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "131afac5faeb4abca95cc2516ab3716a" candidate_uuid: "67c65c18b57e4587b51de2c71106a8f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44d31476c9874fdd9827a0452e9ade31" is_pre_election: true
I20260811 10:05:21.119889 27245 raft_consensus.cc:2454] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67c65c18b57e4587b51de2c71106a8f1 in term 0.
I20260811 10:05:21.119889 27100 raft_consensus.cc:2454] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67c65c18b57e4587b51de2c71106a8f1 in term 0.
I20260811 10:05:21.120129 27321 leader_election.cc:302] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44d31476c9874fdd9827a0452e9ade31, 67c65c18b57e4587b51de2c71106a8f1; no voters:
I20260811 10:05:21.120262 27465 raft_consensus.cc:2781] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:05:21.120321 27465 raft_consensus.cc:482] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:05:21.120349 27465 raft_consensus.cc:3037] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:21.121109 27465 raft_consensus.cc:504] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.121239 27465 leader_election.cc:288] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [CANDIDATE]: Term 1 election: Requested vote from peers 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495), 77d2cc5f45b44d6abec7b4ebcb6637fa (127.9.127.193:36225)
I20260811 10:05:21.121381 27245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "131afac5faeb4abca95cc2516ab3716a" candidate_uuid: "67c65c18b57e4587b51de2c71106a8f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44d31476c9874fdd9827a0452e9ade31"
I20260811 10:05:21.121450 27100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "131afac5faeb4abca95cc2516ab3716a" candidate_uuid: "67c65c18b57e4587b51de2c71106a8f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa"
I20260811 10:05:21.121470 27245 raft_consensus.cc:3037] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:21.121524 27100 raft_consensus.cc:3037] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:21.122393 27245 raft_consensus.cc:2454] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67c65c18b57e4587b51de2c71106a8f1 in term 1.
I20260811 10:05:21.122393 27100 raft_consensus.cc:2454] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67c65c18b57e4587b51de2c71106a8f1 in term 1.
I20260811 10:05:21.122574 27321 leader_election.cc:302] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67c65c18b57e4587b51de2c71106a8f1, 77d2cc5f45b44d6abec7b4ebcb6637fa; no voters:
I20260811 10:05:21.122658 27465 raft_consensus.cc:2781] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:05:21.122859 27465 raft_consensus.cc:686] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 1 LEADER]: Becoming Leader. State: Replica: 67c65c18b57e4587b51de2c71106a8f1, State: Running, Role: LEADER
I20260811 10:05:21.122982 27465 consensus_queue.cc:237] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:21.123895 26942 catalog_manager.cc:5495] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "67c65c18b57e4587b51de2c71106a8f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } health_report { overall_health: HEALTHY } } }
I20260811 10:05:21.139698 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.137547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43756 (local address 127.9.127.195:43689)
0811 10:05:21.137604 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:21.137606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:21.137617 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:05:21.137650 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:21.137651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:21.137668 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:21.137727 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:05:21.137837 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.138303 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.138993 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:21.139174 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:21.139237 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:21.139365 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:05:21.139465 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:05:21.139525 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:21.139555 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 10:05:21.139573 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:05:21.141610 27245 raft_consensus.cc:1261] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 1 FOLLOWER]: Refusing update from remote peer 67c65c18b57e4587b51de2c71106a8f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:05:21.141610 27100 raft_consensus.cc:1261] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Refusing update from remote peer 67c65c18b57e4587b51de2c71106a8f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:05:21.141978 27465 consensus_queue.cc:1035] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:05:21.142153 27468 consensus_queue.cc:1035] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:05:21.145426 27473 mvcc.cc:205] Tried to move back new op lower bound from 7317269385792929792 to 7317269385720373248. Current Snapshot: MvccSnapshot[applied={T|T < 7317269385792929792}]
I20260811 10:05:21.146636 26943 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:05:21.146740 26943 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:05:21.147377 26943 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Sending DeleteTablet for 3 replicas of tablet 131afac5faeb4abca95cc2516ab3716a
I20260811 10:05:21.147673 27225 tablet_service.cc:1514] Processing DeleteTablet for tablet 131afac5faeb4abca95cc2516ab3716a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:21 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:57220
I20260811 10:05:21.147672 27369 tablet_service.cc:1514] Processing DeleteTablet for tablet 131afac5faeb4abca95cc2516ab3716a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:21 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:43740
I20260811 10:05:21.147722 27072 tablet_service.cc:1514] Processing DeleteTablet for tablet 131afac5faeb4abca95cc2516ab3716a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:21 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:55942
I20260811 10:05:21.147912 27484 tablet_replica.cc:330] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: stopping tablet replica
I20260811 10:05:21.147889 27483 tablet_replica.cc:330] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: stopping tablet replica
I20260811 10:05:21.148000 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 27009
I20260811 10:05:21.148001 27483 raft_consensus.cc:2229] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:05:21.148011 27484 raft_consensus.cc:2229] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:05:21.148101 27483 raft_consensus.cc:2258] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:21.148121 27484 raft_consensus.cc:2258] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:21.153333 27484 ts_tablet_manager.cc:1905] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:21.154335 27483 ts_tablet_manager.cc:1905] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:21.155157 27484 ts_tablet_manager.cc:1918] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:21.155241 27484 log.cc:1196] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/131afac5faeb4abca95cc2516ab3716a
I20260811 10:05:21.155525 27484 ts_tablet_manager.cc:1939] T 131afac5faeb4abca95cc2516ab3716a P 67c65c18b57e4587b51de2c71106a8f1: Deleting consensus metadata
I20260811 10:05:21.155982 26928 catalog_manager.cc:4841] TS 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689): tablet 131afac5faeb4abca95cc2516ab3716a (table test-table [id=de4786f1daae4179861cabdbebda4380]) successfully deleted
I20260811 10:05:21.156145 27483 ts_tablet_manager.cc:1918] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:21.156243 27483 log.cc:1196] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/131afac5faeb4abca95cc2516ab3716a
I20260811 10:05:21.156559 27483 ts_tablet_manager.cc:1939] T 131afac5faeb4abca95cc2516ab3716a P 44d31476c9874fdd9827a0452e9ade31: Deleting consensus metadata
I20260811 10:05:21.157028 26927 catalog_manager.cc:4841] TS 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495): tablet 131afac5faeb4abca95cc2516ab3716a (table test-table [id=de4786f1daae4179861cabdbebda4380]) successfully deleted
W20260811 10:05:21.160493 26927 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:36225 (error 108)
I20260811 10:05:21.160673 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 27155
I20260811 10:05:21.164372 27452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:21.160950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:36225 (local address 127.0.0.1:55946)
0811 10:05:21.164289 (+ 3339us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:21.164338 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3315}
W20260811 10:05:21.165915 26927 catalog_manager.cc:4584] TS 77d2cc5f45b44d6abec7b4ebcb6637fa (127.9.127.193:36225): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 131afac5faeb4abca95cc2516ab3716a: Network error: Client connection negotiation failed: client connection to 127.9.127.193:36225: connect: Connection refused (error 111)
I20260811 10:05:21.168931 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 27301
I20260811 10:05:21.174671 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 26906
I20260811 10:05:41.181704 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33125
--webserver_interface=127.9.127.254
--webserver_port=45581
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:33125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:05:41.265185 27487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:41.265398 27487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:41.265421 27487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:41.266593 27487 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 10:05:41.266634 27487 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 10:05:41.266649 27487 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 10:05:41.266660 27487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:05:41.266721 27487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:41.266738 27487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:41.266764 27487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:05:41.266796 27487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:05:41.268296 27487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:33125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=45581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:41.268563 27487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:41.268850 27487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 10:05:41.278520 27487 server_base.cc:1034] running on GCE node
W20260811 10:05:41.278467 27495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:41.278484 27497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:41.278472 27494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:41.278909 27487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:41.279240 27487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:41.280385 27487 hybrid_clock.cc:648] HybridClock initialized: now 1786442741280367 us; error 39 us; skew 500 ppm
Aug 11 10:05:41 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442741, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:41.288903 27487 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:05:41.289433 27487 webserver.cc:460] Webserver started at http://127.9.127.254:45581/ using document root <none> and password file <none>
I20260811 10:05:41.289721 27487 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:41.289783 27487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:41.291302 27487 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 10:05:41.292001 27505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:41.292197 27487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:05:41.292299 27487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "56aa245b0d3545a8a90920160a9ca38e"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "248720ae5bd06592830279d1bdcb73f8"
server_key_iv: "5a57098f76b14909b4322f89a0742e76"
server_key_version: "encryptionkey@0"
I20260811 10:05:41.292725 27487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:41.312122 27487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:41.314195 27487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:41.314344 27487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:41.318866 27487 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:33125
I20260811 10:05:41.318924 27562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:33125 every 8 connection(s)
I20260811 10:05:41.319346 27487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:05:41.321082 27563 sys_catalog.cc:263] Verifying existing consensus state
I20260811 10:05:41.321806 27563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Bootstrap starting.
I20260811 10:05:41.328050 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 27487
I20260811 10:05:41.328341 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:36225
--local_ip_for_outbound_sockets=127.9.127.193
--tserver_master_addrs=127.9.127.254:33125
--webserver_port=38725
--webserver_interface=127.9.127.193
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:05:41.331698 27563 log.cc:824] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:41.333973 27563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:05:41.334378 27563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Bootstrap complete.
I20260811 10:05:41.336869 27563 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:05:41.337157 27563 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56aa245b0d3545a8a90920160a9ca38e, State: Initialized, Role: FOLLOWER
I20260811 10:05:41.337347 27563 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:05:41.337433 27563 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:05:41.337515 27563 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:05:41.337572 27563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 1 FOLLOWER]: Advancing to term 2
I20260811 10:05:41.338662 27563 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:05:41.338792 27563 leader_election.cc:302] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56aa245b0d3545a8a90920160a9ca38e; no voters:
I20260811 10:05:41.339000 27563 leader_election.cc:288] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 10:05:41.339076 27567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 10:05:41.339244 27567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 2 LEADER]: Becoming Leader. State: Replica: 56aa245b0d3545a8a90920160a9ca38e, State: Running, Role: LEADER
I20260811 10:05:41.339285 27563 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:05:41.339447 27567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:05:41.340451 27568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "56aa245b0d3545a8a90920160a9ca38e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } } }
I20260811 10:05:41.340572 27568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:41.340842 27579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:05:41.341118 27569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56aa245b0d3545a8a90920160a9ca38e. Latest consensus state: current_term: 2 leader_uuid: "56aa245b0d3545a8a90920160a9ca38e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } } }
I20260811 10:05:41.341209 27569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: This master's current role is: LEADER
I20260811 10:05:41.341632 27579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:05:41.341727 27579 catalog_manager.cc:1259] Loaded cluster ID: 6cb955e980c4420186a2be7a35575c87
I20260811 10:05:41.341756 27579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:05:41.342957 27579 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:05:41.343147 27579 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Loaded TSK: 0
I20260811 10:05:41.354050 27579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Generated new TSK 1
I20260811 10:05:41.354146 27579 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 10:05:41.419305 27565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:41.419521 27565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:41.419544 27565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:41.420679 27565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:41.420720 27565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:41.420746 27565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:05:41.422201 27565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:36225
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=38725
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:41.422432 27565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:41.422713 27565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:41.428769 27593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:41.428726 27592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:41.428750 27595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:41.429037 27565 server_base.cc:1034] running on GCE node
I20260811 10:05:41.429258 27565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:41.429574 27565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:41.430770 27565 hybrid_clock.cc:648] HybridClock initialized: now 1786442741430756 us; error 27 us; skew 500 ppm
Aug 11 10:05:41 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442741, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:41.434134 27565 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:05:41.434692 27565 webserver.cc:460] Webserver started at http://127.9.127.193:38725/ using document root <none> and password file <none>
I20260811 10:05:41.434938 27565 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:41.435032 27565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:41.436496 27565 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:05:41.437361 27603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:41.437552 27565 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 10:05:41.437652 27565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "381f7ab52d079e0e7b1ff514d339a7d6"
server_key_iv: "d5c27d4802ddf2ab5db50cc0d3d4377d"
server_key_version: "encryptionkey@0"
I20260811 10:05:41.438019 27565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:41.459460 27565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:41.461850 27565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:41.462021 27565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:41.462308 27565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:41.462831 27610 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 10:05:41.464345 27565 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 10:05:41.464401 27565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 10:05:41.464427 27565 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 10:05:41.465234 27565 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 10:05:41.465282 27565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:41.465327 27610 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Bootstrap starting.
I20260811 10:05:41.473121 27565 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:36225
I20260811 10:05:41.473351 27729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:36225 every 8 connection(s)
I20260811 10:05:41.473626 27565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:05:41.475153 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 27565
I20260811 10:05:41.475514 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:39495
--local_ip_for_outbound_sockets=127.9.127.194
--tserver_master_addrs=127.9.127.254:33125
--webserver_port=42427
--webserver_interface=127.9.127.194
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:05:41.477982 27610 log.cc:824] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:41.480386 27610 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:05:41.480701 27610 tablet_bootstrap.cc:492] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Bootstrap complete.
I20260811 10:05:41.481936 27610 ts_tablet_manager.cc:1397] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.010s
I20260811 10:05:41.483202 27610 raft_consensus.cc:348] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:41.483446 27610 raft_consensus.cc:729] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d2cc5f45b44d6abec7b4ebcb6637fa, State: Initialized, Role: FOLLOWER
Aug 11 10:05:41 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442741, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:41.483624 27610 consensus_queue.cc:260] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } }
I20260811 10:05:41.483999 27610 ts_tablet_manager.cc:1428] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:05:41.487797 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.474521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:44053 (local address 127.9.127.254:33125)
0811 10:05:41.477086 (+ 2565us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.477096 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.477136 (+ 40us) server_negotiation.cc:407] Connection header received
0811 10:05:41.477273 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.477279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.477343 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.478424 (+ 1081us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:41.478519 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.479383 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.480931 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.481314 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.481444 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.484286 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:41.484290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:41.484290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:41.484300 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:41.485940 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.486504 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.486507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.486507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.486595 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.486890 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.486890 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.486890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.487108 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:41.487173 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.487558 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.487665 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2507,"thread_start_us":86,"threads_started":1}
I20260811 10:05:41.487941 27732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.474359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:44053)
0811 10:05:41.474559 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:41.474617 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:41.475364 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:41.477570 (+ 2206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:41.477575 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:41.477966 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:41.478259 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.478266 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.479529 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.479531 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.480853 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.480856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.481423 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.481424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.481585 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.482196 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:41.482205 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:41.484178 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:41.486050 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:41.486059 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:41.486061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:41.486400 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:41.486663 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:41.486664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:41.486665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:41.486818 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:41.487190 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:41.487198 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:41.487367 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 10:05:41.487515 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 10:05:41.487702 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":112,"threads_started":1}
I20260811 10:05:41.488903 27730 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33125
I20260811 10:05:41.489012 27730 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:41.489213 27730 heartbeater.cc:511] Master 127.9.127.254:33125 requested a full tablet report, sending...
I20260811 10:05:41.490037 27522 ts_manager.cc:194] Registered new tserver with Master: 77d2cc5f45b44d6abec7b4ebcb6637fa (127.9.127.193:36225)
I20260811 10:05:41.491366 27522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:44053
I20260811 10:05:41.492275 27730 heartbeater.cc:503] Master 127.9.127.254:33125 was elected leader, sending a full tablet report...
Aug 11 10:05:41 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442741, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.193@KRBTEST.COM
I20260811 10:05:41.499174 27738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.490782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41130 (local address 127.9.127.193:36225)
0811 10:05:41.490934 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.490938 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.491101 (+ 163us) server_negotiation.cc:407] Connection header received
0811 10:05:41.491221 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.491223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.491247 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.491325 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:41.491868 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.493026 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.493748 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.494181 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.494251 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.496400 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:41.496407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:41.496407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:41.496413 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:41.497936 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.498404 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.498407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.498407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.498459 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.498669 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.498670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.498670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.498793 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:41.498852 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.499036 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.499117 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260811 10:05:41.499213 27737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.490730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:36225 (local address 127.0.0.1:41130)
0811 10:05:41.490995 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:41.491021 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:41.491121 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:41.491328 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:41.491335 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:41.491688 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:41.491752 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.491755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.493107 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.493107 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.493668 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.493670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.494250 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.494251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.494307 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.494746 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:41.494750 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:41.496321 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:41.498014 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:41.498021 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:41.498023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:41.498321 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:41.498529 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:41.498530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:41.498531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:41.498606 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:41.498858 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:41.498864 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:41.498916 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 10:05:41.499002 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 10:05:41.499113 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":90,"threads_started":1}
I20260811 10:05:41.499684 27655 tablet_service.cc:1514] Processing DeleteTablet for tablet 131afac5faeb4abca95cc2516ab3716a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:21 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:41130
I20260811 10:05:41.500264 27739 tablet_replica.cc:330] stopping tablet replica
I20260811 10:05:41.500368 27739 raft_consensus.cc:2229] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:05:41.500437 27739 raft_consensus.cc:2258] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:41.500734 27739 ts_tablet_manager.cc:1905] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:41.502785 27739 ts_tablet_manager.cc:1918] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:41.502849 27739 log.cc:1196] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal/wals/131afac5faeb4abca95cc2516ab3716a
I20260811 10:05:41.503082 27739 ts_tablet_manager.cc:1939] T 131afac5faeb4abca95cc2516ab3716a P 77d2cc5f45b44d6abec7b4ebcb6637fa: Deleting consensus metadata
I20260811 10:05:41.503556 27508 catalog_manager.cc:4841] TS 77d2cc5f45b44d6abec7b4ebcb6637fa (127.9.127.193:36225): tablet 131afac5faeb4abca95cc2516ab3716a (table test-table [id=de4786f1daae4179861cabdbebda4380]) successfully deleted
W20260811 10:05:41.567760 27734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:41.568001 27734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:41.568040 27734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:41.569305 27734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:41.569371 27734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:41.569418 27734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:05:41.570866 27734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:39495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=42427
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:41.571136 27734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:41.571362 27734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:41.576392 27744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:41.576391 27745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:41.576454 27747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:41.576669 27734 server_base.cc:1034] running on GCE node
I20260811 10:05:41.576895 27734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:41.577173 27734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:41.578338 27734 hybrid_clock.cc:648] HybridClock initialized: now 1786442741578312 us; error 44 us; skew 500 ppm
Aug 11 10:05:41 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442741, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:41.581064 27734 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:05:41.581501 27734 webserver.cc:460] Webserver started at http://127.9.127.194:42427/ using document root <none> and password file <none>
I20260811 10:05:41.581697 27734 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:41.581748 27734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:41.583083 27734 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:41.583689 27755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:41.583897 27734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:41.583990 27734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "44d31476c9874fdd9827a0452e9ade31"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "a82ad3c2f823d090b5f2bef4e03c5459"
server_key_iv: "f1898fdbb2ebf72798c106e732639b0f"
server_key_version: "encryptionkey@0"
I20260811 10:05:41.584344 27734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:41.616557 27734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:41.619143 27734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:41.619267 27734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:41.619555 27734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:41.619849 27734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:41.619880 27734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:41.619903 27734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:41.619916 27734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:41.626925 27734 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:39495
I20260811 10:05:41.626968 27879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:39495 every 8 connection(s)
I20260811 10:05:41.627342 27734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:05:41 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442741, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:41.635926 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 27734
I20260811 10:05:41.636247 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:43689
--local_ip_for_outbound_sockets=127.9.127.195
--tserver_master_addrs=127.9.127.254:33125
--webserver_port=40487
--webserver_interface=127.9.127.195
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:05:41.636622 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.628157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:57463 (local address 127.9.127.254:33125)
0811 10:05:41.628222 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.628224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.628424 (+ 200us) server_negotiation.cc:407] Connection header received
0811 10:05:41.628928 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.628929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.628942 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.629010 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:41.629994 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.630519 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.631566 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.631799 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.631849 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.634030 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:41.634031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:41.634031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:41.634037 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:41.635255 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.635618 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.635619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.635619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.635670 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.635927 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.635928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.635928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.636087 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:41.636170 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.636481 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.636556 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:05:41.637120 27882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.628118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:57463)
0811 10:05:41.628287 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:41.628332 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:41.628842 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:41.629065 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:41.629068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:41.629643 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:41.629896 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.629902 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.630598 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.630599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.631480 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.631482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.631885 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.631886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.632004 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.632565 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:41.632574 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:41.633930 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:41.635330 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:41.635336 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:41.635338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:41.635551 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:41.635761 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:41.635762 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:41.635762 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:41.635858 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:41.636160 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:41.636166 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:41.636278 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 10:05:41.636760 (+ 482us) client_negotiation.cc:240] Negotiation successful
0811 10:05:41.636944 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260811 10:05:41.637598 27880 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33125
I20260811 10:05:41.637708 27880 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:41.637907 27880 heartbeater.cc:511] Master 127.9.127.254:33125 requested a full tablet report, sending...
I20260811 10:05:41.638340 27522 ts_manager.cc:194] Registered new tserver with Master: 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495)
I20260811 10:05:41.638751 27522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:57463
W20260811 10:05:41.720206 27883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:05:41.720402 27883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:05:41.720425 27883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:05:41.721527 27883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:05:41.721565 27883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:05:41.721593 27883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:05:41.723054 27883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:43689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=40487
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:05:41.723245 27883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:05:41.723408 27883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:05:41.728361 27891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:41.728355 27888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:05:41.728464 27889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:05:41.728550 27883 server_base.cc:1034] running on GCE node
I20260811 10:05:41.728823 27883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:05:41.729034 27883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:05:41.730173 27883 hybrid_clock.cc:648] HybridClock initialized: now 1786442741730157 us; error 31 us; skew 500 ppm
Aug 11 10:05:41 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442741, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:05:41.732641 27883 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:05:41.733165 27883 webserver.cc:460] Webserver started at http://127.9.127.195:40487/ using document root <none> and password file <none>
I20260811 10:05:41.733395 27883 fs_manager.cc:359] Metadata directory not provided
I20260811 10:05:41.733475 27883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:05:41.734750 27883 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:05:41.735306 27898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:41.735474 27883 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:05:41.735587 27883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "67c65c18b57e4587b51de2c71106a8f1"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "fa7eaa732c13db4bc6d8c47952d176f8"
server_key_iv: "a382198b70201dc41101b1b7a21a3343"
server_key_version: "encryptionkey@0"
I20260811 10:05:41.735911 27883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:05:41.743316 27883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:05:41.745635 27883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:05:41.745800 27883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:05:41.746025 27883 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:05:41.746340 27883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:05:41.746394 27883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:41.746428 27883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:05:41.746456 27883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:05:41.752290 27883 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:43689
I20260811 10:05:41.752339 28018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:43689 every 8 connection(s)
I20260811 10:05:41.752694 27883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
Aug 11 10:05:41 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442741, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:05:41.761220 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.753452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:50917 (local address 127.9.127.254:33125)
0811 10:05:41.753520 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.753522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.753750 (+ 228us) server_negotiation.cc:407] Connection header received
0811 10:05:41.754214 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.754215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.754225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.754280 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:41.755139 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.755621 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.756542 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.756733 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.756837 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.758805 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:41.758806 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:41.758806 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:41.758813 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:41.760015 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.760378 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.760379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.760379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.760434 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.760664 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.760664 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.760664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.760762 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:41.760871 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.761091 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.761156 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 10:05:41.761361 28022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.753440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:50917)
0811 10:05:41.753627 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:41.753668 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:41.754131 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:41.754330 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:41.754333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:41.754874 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:05:41.755057 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.755061 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.755702 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.755703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.756472 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.756474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.756847 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.756848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.756973 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.757373 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:05:41.757381 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:05:41.758719 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:05:41.760088 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:41.760095 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:41.760096 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:41.760305 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:41.760493 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:05:41.760494 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:05:41.760494 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:05:41.760607 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:05:41.760863 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:05:41.760869 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:05:41.760978 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 10:05:41.761062 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 10:05:41.761177 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260811 10:05:41.761878 28019 heartbeater.cc:347] Connected to a master server at 127.9.127.254:33125
I20260811 10:05:41.761999 28019 heartbeater.cc:464] Registering TS with master...
I20260811 10:05:41.762179 28019 heartbeater.cc:511] Master 127.9.127.254:33125 requested a full tablet report, sending...
I20260811 10:05:41.762543 27522 ts_manager.cc:194] Registered new tserver with Master: 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689)
I20260811 10:05:41.762718 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 27883
I20260811 10:05:41.762974 27522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:50917
I20260811 10:05:41.768613 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.763152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33052 (local address 127.9.127.254:33125)
0811 10:05:41.763208 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.763210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.763369 (+ 159us) server_negotiation.cc:407] Connection header received
0811 10:05:41.763417 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.763418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.763427 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.763515 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:41.764103 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.764535 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.765319 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.765492 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.765546 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.766688 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:41.766688 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:41.766689 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:41.766693 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:41.767753 (+ 1060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.768048 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.768049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.768049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.768095 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:41.768264 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:41.768264 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:41.768264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:41.768349 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:41.768467 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.768494 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.768547 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 10:05:41.769472 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:05:41.771802 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.769767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33056 (local address 127.9.127.254:33125)
0811 10:05:41.769800 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.769802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.769909 (+ 107us) server_negotiation.cc:407] Connection header received
0811 10:05:41.769965 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.769965 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.769992 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.770046 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:05:41.770146 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.770551 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.771244 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.771408 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.771455 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.771586 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:05:41.771665 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:05:41.771717 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.771749 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.771761 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 10:05:41.772065 27522 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33056:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:05:41.773703 27522 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:05:41.775873 27655 tablet_service.cc:1467] Processing CreateTablet for tablet 582637b364f44d45a63cd8823936ea55 (DEFAULT_TABLE table=test-table [id=b89f586471754370902fb3573f5e70b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:41.776127 27655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582637b364f44d45a63cd8823936ea55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:41.777910 27610 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Bootstrap starting.
I20260811 10:05:41.778292 27610 tablet_bootstrap.cc:654] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:41.778973 27610 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: No bootstrap required, opened a new log
I20260811 10:05:41.779026 27610 ts_tablet_manager.cc:1397] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 10:05:41.779264 27737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.775524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39495 (local address 127.0.0.1:59350)
0811 10:05:41.775586 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:41.775597 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:41.775634 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:41.775992 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:41.775993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:41.775995 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:41.776034 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.776036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.777146 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.777147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.777918 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.777922 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.778997 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.778998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.779074 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.779097 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 10:05:41.779159 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 10:05:41.779199 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 10:05:41.779348 28027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.775637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59350 (local address 127.9.127.194:39495)
0811 10:05:41.775805 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.775809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.775821 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:05:41.775864 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.775867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.775883 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.775971 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:41.776092 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.777017 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.778056 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.778907 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.778987 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.779052 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.779191 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.779244 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260811 10:05:41.779422 27610 raft_consensus.cc:348] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.779505 27610 raft_consensus.cc:374] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:41.779557 27610 raft_consensus.cc:729] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d2cc5f45b44d6abec7b4ebcb6637fa, State: Initialized, Role: FOLLOWER
I20260811 10:05:41.779616 27610 consensus_queue.cc:260] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.779716 27610 ts_tablet_manager.cc:1428] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 10:05:41.780480 28026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.775583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43689 (local address 127.0.0.1:33052)
0811 10:05:41.775818 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:41.775828 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:41.775882 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:41.777040 (+ 1158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:41.777041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:41.777044 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:41.777089 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.777091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.778284 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.778285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.779362 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.779366 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.780233 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.780234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.780325 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.780329 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:05:41.780382 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 10:05:41.780420 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":46,"threads_started":1}
I20260811 10:05:41.780777 28028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.775744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33052 (local address 127.9.127.195:43689)
0811 10:05:41.776881 (+ 1137us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.776885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.776896 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:05:41.776928 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.776930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.776944 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.777023 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:41.777195 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.778200 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.779463 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.780160 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.780230 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.780280 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.780654 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.780701 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1107,"thread_start_us":82,"threads_started":1}
I20260811 10:05:41.781030 27804 tablet_service.cc:1467] Processing CreateTablet for tablet 582637b364f44d45a63cd8823936ea55 (DEFAULT_TABLE table=test-table [id=b89f586471754370902fb3573f5e70b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:41.781445 27804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582637b364f44d45a63cd8823936ea55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:41.781395 27951 tablet_service.cc:1467] Processing CreateTablet for tablet 582637b364f44d45a63cd8823936ea55 (DEFAULT_TABLE table=test-table [id=b89f586471754370902fb3573f5e70b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:05:41.781715 27951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582637b364f44d45a63cd8823936ea55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:05:41.784970 28031 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Bootstrap starting.
I20260811 10:05:41.785046 28030 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Bootstrap starting.
I20260811 10:05:41.785741 28031 tablet_bootstrap.cc:654] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:41.785742 28030 tablet_bootstrap.cc:654] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Neither blocks nor log segments found. Creating new log.
I20260811 10:05:41.786387 28030 log.cc:824] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:41.786387 28031 log.cc:824] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Log is configured to *not* fsync() on all Append() calls
I20260811 10:05:41.787261 28031 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: No bootstrap required, opened a new log
I20260811 10:05:41.787336 28031 ts_tablet_manager.cc:1397] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:05:41.787358 28030 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: No bootstrap required, opened a new log
I20260811 10:05:41.787415 28030 ts_tablet_manager.cc:1397] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:05:41.789348 28031 raft_consensus.cc:348] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.789350 28030 raft_consensus.cc:348] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.789537 28031 raft_consensus.cc:374] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:41.789537 28030 raft_consensus.cc:374] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:05:41.789577 28031 raft_consensus.cc:729] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67c65c18b57e4587b51de2c71106a8f1, State: Initialized, Role: FOLLOWER
I20260811 10:05:41.789589 28030 raft_consensus.cc:729] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44d31476c9874fdd9827a0452e9ade31, State: Initialized, Role: FOLLOWER
I20260811 10:05:41.789706 28031 consensus_queue.cc:260] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.789706 28030 consensus_queue.cc:260] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.790001 28030 ts_tablet_manager.cc:1428] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:05:41.790017 28019 heartbeater.cc:503] Master 127.9.127.254:33125 was elected leader, sending a full tablet report...
I20260811 10:05:41.790001 28031 ts_tablet_manager.cc:1428] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:05:41.790215 27880 heartbeater.cc:503] Master 127.9.127.254:33125 was elected leader, sending a full tablet report...
W20260811 10:05:41.877939 27881 tablet.cc:2369] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:05:41.959463 27736 raft_consensus.cc:482] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:05:41.959615 27736 raft_consensus.cc:504] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.959940 27736 leader_election.cc:288] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495), 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689)
I20260811 10:05:41.962956 28027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.960245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:52133 (local address 127.9.127.194:39495)
0811 10:05:41.960293 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.960295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.960305 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:05:41.960386 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.960386 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.960399 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.960481 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:41.960673 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.961182 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.962194 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.962566 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.962658 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.962668 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.962854 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.962892 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 10:05:41.962956 27732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.960148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39495 (local address 127.9.127.193:52133)
0811 10:05:41.960242 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:41.960254 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:41.960312 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:41.960484 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:41.960485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:41.960487 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:41.960597 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.960599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.961277 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.961278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.962096 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.962097 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.962658 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.962659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.962749 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.962768 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 10:05:41.962834 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 10:05:41.962880 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":10}
I20260811 10:05:41.963033 28028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.960282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:38359 (local address 127.9.127.195:43689)
0811 10:05:41.960340 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:41.960343 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:41.960377 (+ 34us) server_negotiation.cc:407] Connection header received
0811 10:05:41.960463 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:41.960464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:41.960483 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:41.960551 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:05:41.960725 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.961236 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.962272 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.962660 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.962748 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.962757 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:41.962924 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 10:05:41.962958 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:05:41.963119 28036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:41.960193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43689 (local address 127.9.127.193:38359)
0811 10:05:41.960318 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:41.960330 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:05:41.960395 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:05:41.960557 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:05:41.960558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:05:41.960559 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:05:41.960647 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.960649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.961332 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.961333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.962184 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:05:41.962186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:05:41.962764 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:05:41.962766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:05:41.962836 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:41.962839 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:05:41.962905 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 10:05:41.962945 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":62,"threads_started":1}
I20260811 10:05:41.963346 27829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582637b364f44d45a63cd8823936ea55" candidate_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44d31476c9874fdd9827a0452e9ade31" is_pre_election: true
I20260811 10:05:41.963420 27971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582637b364f44d45a63cd8823936ea55" candidate_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67c65c18b57e4587b51de2c71106a8f1" is_pre_election: true
I20260811 10:05:41.963536 27829 raft_consensus.cc:2454] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d2cc5f45b44d6abec7b4ebcb6637fa in term 0.
I20260811 10:05:41.963551 27971 raft_consensus.cc:2454] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77d2cc5f45b44d6abec7b4ebcb6637fa in term 0.
I20260811 10:05:41.963804 27607 leader_election.cc:302] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67c65c18b57e4587b51de2c71106a8f1, 77d2cc5f45b44d6abec7b4ebcb6637fa; no voters:
I20260811 10:05:41.963989 27736 raft_consensus.cc:2781] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:05:41.964053 27736 raft_consensus.cc:482] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:05:41.964071 27736 raft_consensus.cc:3037] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:41.964852 27736 raft_consensus.cc:504] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.965008 27736 leader_election.cc:288] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 1 election: Requested vote from peers 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495), 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689)
I20260811 10:05:41.965193 27829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582637b364f44d45a63cd8823936ea55" candidate_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44d31476c9874fdd9827a0452e9ade31"
I20260811 10:05:41.965185 27971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582637b364f44d45a63cd8823936ea55" candidate_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67c65c18b57e4587b51de2c71106a8f1"
I20260811 10:05:41.965271 27971 raft_consensus.cc:3037] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:41.965271 27829 raft_consensus.cc:3037] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:05:41.966224 27829 raft_consensus.cc:2454] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d2cc5f45b44d6abec7b4ebcb6637fa in term 1.
I20260811 10:05:41.966224 27971 raft_consensus.cc:2454] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77d2cc5f45b44d6abec7b4ebcb6637fa in term 1.
I20260811 10:05:41.966398 27607 leader_election.cc:302] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67c65c18b57e4587b51de2c71106a8f1, 77d2cc5f45b44d6abec7b4ebcb6637fa; no voters:
I20260811 10:05:41.966548 27736 raft_consensus.cc:2781] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:05:41.966696 27736 raft_consensus.cc:686] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 LEADER]: Becoming Leader. State: Replica: 77d2cc5f45b44d6abec7b4ebcb6637fa, State: Running, Role: LEADER
I20260811 10:05:41.966754 27736 consensus_queue.cc:237] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:05:41.967638 27521 catalog_manager.cc:5495] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 77d2cc5f45b44d6abec7b4ebcb6637fa (127.9.127.193). New cstate: current_term: 1 leader_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } health_report { overall_health: HEALTHY } } }
W20260811 10:05:41.977636 27731 tablet.cc:2369] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:05:42.003286 28021 tablet.cc:2369] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:05:42.005908 28040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:42.003420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41134 (local address 127.9.127.193:36225)
0811 10:05:42.003564 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:42.003566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:42.003572 (+ 6us) server_negotiation.cc:407] Connection header received
0811 10:05:42.003607 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:42.003608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:42.003627 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:42.003729 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:05:42.003896 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:42.004387 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:42.005160 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:42.005355 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:42.005431 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:42.005609 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:05:42.005662 (+ 53us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 10:05:42.005811 (+ 149us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41134: token expired
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
W20260811 10:05:42.005962 28040 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41134: token expired
I20260811 10:05:42.011726 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:42.006306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33066 (local address 127.9.127.254:33125)
0811 10:05:42.006365 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:42.006372 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:42.006379 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:05:42.006398 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:42.006399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:42.006407 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:42.006454 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:05:42.007040 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:42.007482 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:42.008120 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:42.008298 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:42.008346 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:42.009487 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:05:42.009488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:05:42.009488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:05:42.009495 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:05:42.010785 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:42.011103 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:42.011104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:42.011104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:42.011156 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:05:42.011317 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:05:42.011318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:05:42.011318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:05:42.011412 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:05:42.011481 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:42.011578 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 10:05:42.011641 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:05:42.014737 28040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:42.012691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41144 (local address 127.9.127.193:36225)
0811 10:05:42.012745 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:05:42.012746 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:05:42.012754 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:05:42.012827 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:05:42.012827 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:05:42.012837 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:05:42.012896 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:05:42.013008 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:42.013451 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:42.014080 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:05:42.014253 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:05:42.014302 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:05:42.014415 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:05:42.014503 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:05:42.014543 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 10:05:42.014608 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 10:05:42.014625 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 10:05:42.016247 27971 raft_consensus.cc:1261] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 1 FOLLOWER]: Refusing update from remote peer 77d2cc5f45b44d6abec7b4ebcb6637fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:05:42.016265 27829 raft_consensus.cc:1261] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 1 FOLLOWER]: Refusing update from remote peer 77d2cc5f45b44d6abec7b4ebcb6637fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:05:42.016621 27736 consensus_queue.cc:1035] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:05:42.016754 28037 consensus_queue.cc:1035] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:05:42.019277 28041 mvcc.cc:205] Tried to move back new op lower bound from 7317269471295975424 to 7317269471096565760. Current Snapshot: MvccSnapshot[applied={T|T < 7317269471295975424}]
I20260811 10:05:42.019424 28042 mvcc.cc:205] Tried to move back new op lower bound from 7317269471295975424 to 7317269471096565760. Current Snapshot: MvccSnapshot[applied={T|T < 7317269471295975424}]
I20260811 10:05:42.019771 28043 mvcc.cc:205] Tried to move back new op lower bound from 7317269471295975424 to 7317269471096565760. Current Snapshot: MvccSnapshot[applied={T|T < 7317269471295975424}]
I20260811 10:05:42.021760 27522 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:05:42.021863 27522 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:05:42.022569 27522 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Sending DeleteTablet for 3 replicas of tablet 582637b364f44d45a63cd8823936ea55
I20260811 10:05:42.022920 27951 tablet_service.cc:1514] Processing DeleteTablet for tablet 582637b364f44d45a63cd8823936ea55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:42 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:33052
I20260811 10:05:42.022921 27804 tablet_service.cc:1514] Processing DeleteTablet for tablet 582637b364f44d45a63cd8823936ea55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:42 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:59350
I20260811 10:05:42.022950 27655 tablet_service.cc:1514] Processing DeleteTablet for tablet 582637b364f44d45a63cd8823936ea55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:05:42 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:41130
I20260811 10:05:42.023145 28051 tablet_replica.cc:330] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: stopping tablet replica
I20260811 10:05:42.023214 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 27565
I20260811 10:05:42.023240 28051 raft_consensus.cc:2229] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:05:42.023336 28051 raft_consensus.cc:2258] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:42.025206 28053 tablet_replica.cc:330] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: stopping tablet replica
I20260811 10:05:42.025389 28053 raft_consensus.cc:2229] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:05:42.025596 28053 raft_consensus.cc:2258] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:05:42.027312 28053 ts_tablet_manager.cc:1905] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:42.027729 28051 ts_tablet_manager.cc:1905] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:05:42.029675 28051 ts_tablet_manager.cc:1918] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:42.029755 28051 log.cc:1196] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/582637b364f44d45a63cd8823936ea55
I20260811 10:05:42.029744 28053 ts_tablet_manager.cc:1918] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:05:42.029928 28053 log.cc:1196] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/582637b364f44d45a63cd8823936ea55
I20260811 10:05:42.030063 28051 ts_tablet_manager.cc:1939] T 582637b364f44d45a63cd8823936ea55 P 67c65c18b57e4587b51de2c71106a8f1: Deleting consensus metadata
I20260811 10:05:42.030495 27509 catalog_manager.cc:4841] TS 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689): tablet 582637b364f44d45a63cd8823936ea55 (table test-table [id=b89f586471754370902fb3573f5e70b2]) successfully deleted
I20260811 10:05:42.030510 28053 ts_tablet_manager.cc:1939] T 582637b364f44d45a63cd8823936ea55 P 44d31476c9874fdd9827a0452e9ade31: Deleting consensus metadata
I20260811 10:05:42.031005 27508 catalog_manager.cc:4841] TS 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495): tablet 582637b364f44d45a63cd8823936ea55 (table test-table [id=b89f586471754370902fb3573f5e70b2]) successfully deleted
W20260811 10:05:42.033835 27508 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:36225 (error 108)
I20260811 10:05:42.034350 28026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:05:42.034225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:36225 (local address 127.0.0.1:41148)
0811 10:05:42.034280 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 10:05:42.034323 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 10:05:42.034453 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 27734
W20260811 10:05:42.034505 27508 catalog_manager.cc:4584] TS 77d2cc5f45b44d6abec7b4ebcb6637fa (127.9.127.193:36225): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 582637b364f44d45a63cd8823936ea55: Network error: Client connection negotiation failed: client connection to 127.9.127.193:36225: connect: Connection refused (error 111)
I20260811 10:05:42.042605 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 27883
I20260811 10:05:42.050177 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 27487
I20260811 10:06:02.057988 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33125
--webserver_interface=127.9.127.254
--webserver_port=45581
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:33125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:02.142791 28055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:02.143005 28055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:02.143028 28055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:02.144164 28055 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 10:06:02.144203 28055 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 10:06:02.144217 28055 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 10:06:02.144228 28055 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:02.144241 28055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:02.144254 28055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:02.144305 28055 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:02.144322 28055 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:02.145872 28055 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:33125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:33125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=45581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:02.146132 28055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:02.146373 28055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:02.151475 28060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:02.151497 28063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:02.151531 28061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:02.151546 28055 server_base.cc:1034] running on GCE node
I20260811 10:06:02.151983 28055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:02.152287 28055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:02.153470 28055 hybrid_clock.cc:648] HybridClock initialized: now 1786442762153463 us; error 55 us; skew 500 ppm
Aug 11 10:06:02 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442762, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:02.161479 28055 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:02.162029 28055 webserver.cc:460] Webserver started at http://127.9.127.254:45581/ using document root <none> and password file <none>
I20260811 10:06:02.162252 28055 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:02.162298 28055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:02.163761 28055 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:02.164463 28071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:02.164657 28055 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:02.164813 28055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "56aa245b0d3545a8a90920160a9ca38e"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "248720ae5bd06592830279d1bdcb73f8"
server_key_iv: "5a57098f76b14909b4322f89a0742e76"
server_key_version: "encryptionkey@0"
I20260811 10:06:02.165256 28055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:02.178632 28055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:02.180529 28055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:02.180696 28055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:02.185510 28055 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:33125
I20260811 10:06:02.185555 28126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:33125 every 8 connection(s)
I20260811 10:06:02.185971 28055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:02.187479 28127 sys_catalog.cc:263] Verifying existing consensus state
I20260811 10:06:02.188136 28127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Bootstrap starting.
I20260811 10:06:02.194795 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 28055
I20260811 10:06:02.195124 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:36225
--local_ip_for_outbound_sockets=127.9.127.193
--tserver_master_addrs=127.9.127.254:33125
--webserver_port=38725
--webserver_interface=127.9.127.193
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:06:02.197242 28127 log.cc:824] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:02.199419 28127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:06:02.199750 28127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Bootstrap complete.
I20260811 10:06:02.202108 28127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:06:02.202359 28127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56aa245b0d3545a8a90920160a9ca38e, State: Initialized, Role: FOLLOWER
I20260811 10:06:02.202548 28127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:06:02.202626 28127 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:02.202682 28127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:02.202728 28127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 2 FOLLOWER]: Advancing to term 3
I20260811 10:06:02.203724 28127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:06:02.203843 28127 leader_election.cc:302] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56aa245b0d3545a8a90920160a9ca38e; no voters:
I20260811 10:06:02.204056 28127 leader_election.cc:288] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 10:06:02.204092 28131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 3 FOLLOWER]: Leader election won for term 3
I20260811 10:06:02.204221 28131 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [term 3 LEADER]: Becoming Leader. State: Replica: 56aa245b0d3545a8a90920160a9ca38e, State: Running, Role: LEADER
I20260811 10:06:02.204330 28127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:02.204378 28131 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } }
I20260811 10:06:02.204706 28133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "56aa245b0d3545a8a90920160a9ca38e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } } }
I20260811 10:06:02.204839 28133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:02.205153 28132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56aa245b0d3545a8a90920160a9ca38e. Latest consensus state: current_term: 3 leader_uuid: "56aa245b0d3545a8a90920160a9ca38e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56aa245b0d3545a8a90920160a9ca38e" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 33125 } } }
I20260811 10:06:02.205256 28132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:02.205384 28138 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:02.206411 28138 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:02.206607 28138 catalog_manager.cc:1259] Loaded cluster ID: 6cb955e980c4420186a2be7a35575c87
I20260811 10:06:02.206833 28138 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:02.208047 28138 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:02.208220 28138 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Loaded TSK: 0
I20260811 10:06:02.208258 28138 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 56aa245b0d3545a8a90920160a9ca38e: Loaded TSK: 1
F20260811 10:06:02.208523 28138 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8a585b19ad google::LogMessage::Fail() at ??:0
@ 0x7f8a585b488a google::LogMessage::SendToLog() at ??:0
@ 0x7f8a585b14de google::LogMessage::Flush() at ??:0
@ 0x7f8a585b2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8a5ad1e104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8a5ad1bd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f8a6050f1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f8a6050f48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f8a6050f594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f8a604d5c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f8a604dfad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8a5a47f0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8a5a474954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8a5b2d86db start_thread at ??:0
@ 0x7f8a570af61f clone at ??:0
W20260811 10:06:02.304433 28129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:02.304639 28129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:02.304663 28129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:02.305835 28129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:02.305877 28129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:02.305904 28129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:06:02.307364 28129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:36225
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=38725
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:02.307634 28129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:02.307884 28129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:02.312995 28170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:02.313030 28171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:02.313189 28173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:02.313199 28129 server_base.cc:1034] running on GCE node
I20260811 10:06:02.313438 28129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:02.313701 28129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:02.314888 28129 hybrid_clock.cc:648] HybridClock initialized: now 1786442762314861 us; error 43 us; skew 500 ppm
Aug 11 10:06:02 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442762, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:02.317584 28129 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:06:02.318061 28129 webserver.cc:460] Webserver started at http://127.9.127.193:38725/ using document root <none> and password file <none>
I20260811 10:06:02.318310 28129 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:02.318382 28129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:02.319795 28129 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:06:02.320570 28181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:02.320820 28129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:06:02.320927 28129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "381f7ab52d079e0e7b1ff514d339a7d6"
server_key_iv: "d5c27d4802ddf2ab5db50cc0d3d4377d"
server_key_version: "encryptionkey@0"
I20260811 10:06:02.321313 28129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:02.331385 28129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:02.333642 28129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:02.333802 28129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:02.334038 28129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:02.334486 28189 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 10:06:02.336488 28129 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 10:06:02.336555 28129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 10:06:02.336601 28129 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 10:06:02.337334 28129 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 10:06:02.337390 28129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 10:06:02.337468 28189 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Bootstrap starting.
I20260811 10:06:02.344849 28129 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:36225
I20260811 10:06:02.344910 28303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:36225 every 8 connection(s)
I20260811 10:06:02.345345 28129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:06:02.349385 28189 log.cc:824] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:02.351819 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 28129
I20260811 10:06:02.352129 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:39495
--local_ip_for_outbound_sockets=127.9.127.194
--tserver_master_addrs=127.9.127.254:33125
--webserver_port=42427
--webserver_interface=127.9.127.194
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:06:02.352219 28189 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 10:06:02.352528 28189 tablet_bootstrap.cc:492] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Bootstrap complete.
I20260811 10:06:02.353945 28189 ts_tablet_manager.cc:1397] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.012s
I20260811 10:06:02.355468 28189 raft_consensus.cc:348] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:06:02.355829 28189 raft_consensus.cc:729] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d2cc5f45b44d6abec7b4ebcb6637fa, State: Initialized, Role: FOLLOWER
I20260811 10:06:02.356040 28189 consensus_queue.cc:260] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:06:02.356351 28189 ts_tablet_manager.cc:1428] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260811 10:06:02.414790 28306 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:02.346029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:51771)
0811 10:06:02.346196 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.346251 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:02.347069 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:02.414575 (+ 67506us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
W20260811 10:06:02.415109 28304 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:33125 (0 consecutive failures): Network error: Failed to ping master at 127.9.127.254:33125: Client connection negotiation failed: client connection to 127.9.127.254:33125: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 10:06:02.415506 28306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:02.415377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:40113)
0811 10:06:02.415437 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.415482 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 10:06:02.415876 28306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:02.415783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:55895)
0811 10:06:02.415829 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.415857 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 10:06:02.416002 28304 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 10:06:02.437974 28308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:02.438169 28308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:02.438192 28308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:02.439248 28308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:02.439284 28308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:02.439309 28308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:06:02.440672 28308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:39495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=42427
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:02.440954 28308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:02.441197 28308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:02.446283 28315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:02.446285 28314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:02.446568 28308 server_base.cc:1034] running on GCE node
W20260811 10:06:02.446305 28319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:02.446844 28308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:02.447100 28308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:02.448254 28308 hybrid_clock.cc:648] HybridClock initialized: now 1786442762448245 us; error 38 us; skew 500 ppm
Aug 11 10:06:02 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442762, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:02.450729 28308 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:06:02.451159 28308 webserver.cc:460] Webserver started at http://127.9.127.194:42427/ using document root <none> and password file <none>
I20260811 10:06:02.451411 28308 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:02.451481 28308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:02.452770 28308 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:02.453454 28326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:02.453625 28308 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:02.453715 28308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "44d31476c9874fdd9827a0452e9ade31"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "a82ad3c2f823d090b5f2bef4e03c5459"
server_key_iv: "f1898fdbb2ebf72798c106e732639b0f"
server_key_version: "encryptionkey@0"
I20260811 10:06:02.454084 28308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:02.481514 28308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:02.483608 28308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:02.483780 28308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:02.484047 28308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:02.484368 28308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:02.484428 28308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:02.484465 28308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:02.484513 28308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:02.490443 28308 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:39495
I20260811 10:06:02.490499 28446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:39495 every 8 connection(s)
I20260811 10:06:02.490821 28308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:06:02.491851 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:02.491482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:36863)
0811 10:06:02.491642 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.491713 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
W20260811 10:06:02.492268 28447 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:33125 (0 consecutive failures): Network error: Failed to ping master at 127.9.127.254:33125: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
I20260811 10:06:02.492509 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:02.492442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:57525)
0811 10:06:02.492469 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.492493 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260811 10:06:02.492734 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:02.492686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:53131)
0811 10:06:02.492706 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.492723 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260811 10:06:02.492849 28447 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 10:06:02.498694 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 28308
I20260811 10:06:02.499012 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:43689
--local_ip_for_outbound_sockets=127.9.127.195
--tserver_master_addrs=127.9.127.254:33125
--webserver_port=40487
--webserver_interface=127.9.127.195
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:02.581411 28450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:02.581629 28450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:02.581665 28450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:02.582775 28450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:02.582839 28450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:02.582880 28450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:06:02.584345 28450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:43689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=40487
--tserver_master_addrs=127.9.127.254:33125
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:02.584599 28450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:02.584844 28450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:02.589715 28456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:02.589761 28455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:02.589721 28459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:02.589952 28450 server_base.cc:1034] running on GCE node
I20260811 10:06:02.590143 28450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:02.590422 28450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:02.591591 28450 hybrid_clock.cc:648] HybridClock initialized: now 1786442762591573 us; error 29 us; skew 500 ppm
Aug 11 10:06:02 dist-test-slave-1x4g krb5kdc[26893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442762, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:02.594172 28450 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:06:02.594604 28450 webserver.cc:460] Webserver started at http://127.9.127.195:40487/ using document root <none> and password file <none>
I20260811 10:06:02.594825 28450 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:02.594893 28450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:02.596191 28450 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:02.596939 28467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:02.597121 28450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 10:06:02.597216 28450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "67c65c18b57e4587b51de2c71106a8f1"
format_stamp: "Formatted at 2026-08-11 10:05:20 on dist-test-slave-1x4g"
server_key: "fa7eaa732c13db4bc6d8c47952d176f8"
server_key_iv: "a382198b70201dc41101b1b7a21a3343"
server_key_version: "encryptionkey@0"
I20260811 10:06:02.597545 28450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:02.607002 28450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:02.608711 28450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:02.608882 28450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:02.609100 28450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:02.609381 28450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:02.609431 28450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:02.609481 28450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:02.609526 28450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:02.615340 28450 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:43689
I20260811 10:06:02.615392 28594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:43689 every 8 connection(s)
I20260811 10:06:02.615713 28450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:06:02.616680 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:02.616318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:45073)
0811 10:06:02.616470 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.616538 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":76,"threads_started":1}
W20260811 10:06:02.617106 28595 heartbeater.cc:644] Failed to heartbeat to 127.9.127.254:33125 (0 consecutive failures): Network error: Failed to ping master at 127.9.127.254:33125: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
I20260811 10:06:02.617404 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:02.617309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:36465)
0811 10:06:02.617357 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.617382 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 10:06:02.617714 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:02.617627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:46753)
0811 10:06:02.617672 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:02.617694 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 10:06:02.617864 28595 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 10:06:02.625017 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 28450
I20260811 10:06:03.416677 28599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:03.416390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:37973)
0811 10:06:03.416552 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:03.416601 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260811 10:06:03.493376 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:03.493190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:47283)
0811 10:06:03.493296 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:03.493326 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":55,"threads_started":1}
I20260811 10:06:03.618395 28601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:03.618191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:43671)
0811 10:06:03.618306 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:03.618341 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":57,"threads_started":1}
I20260811 10:06:03.904879 28602 raft_consensus.cc:482] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:03.905009 28602 raft_consensus.cc:504] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:06:03.905354 28602 leader_election.cc:288] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495), 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689)
Aug 11 10:06:03 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442762, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.195@KRBTEST.COM
Aug 11 10:06:03 dist-test-slave-1x4g krb5kdc[26893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442762, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.194@KRBTEST.COM
I20260811 10:06:03.916236 28606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:03.905744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:56439 (local address 127.9.127.195:43689)
0811 10:06:03.905892 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:03.905910 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:03.905939 (+ 29us) server_negotiation.cc:407] Connection header received
0811 10:06:03.906392 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:03.906394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:03.906437 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:03.906600 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:03.907370 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:03.908233 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:03.909418 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:03.909829 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:03.909963 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:03.912412 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:03.912416 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:03.912433 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:03.912446 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:03.914552 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:03.914985 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:03.914988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:03.914988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:03.915086 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:03.915346 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:03.915347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:03.915348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:03.915593 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:03.915692 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:03.915980 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 10:06:03.916119 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260811 10:06:03.916257 28603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:03.905573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43689 (local address 127.9.127.193:56439)
0811 10:06:03.905705 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:03.905716 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:03.905775 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:03.906648 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:03.906651 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:03.907050 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:03.907228 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:03.907234 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:03.908347 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:03.908348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:03.909325 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:03.909328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:03.909939 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:03.909940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:03.910050 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:03.910664 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:03.910684 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:03.912274 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:03.914643 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:03.914650 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:03.914652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:03.914867 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:03.915169 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:03.915170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:03.915171 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:03.915275 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:03.915686 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:03.915694 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:03.915815 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 10:06:03.915921 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 10:06:03.916101 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":5,"thread_start_us":56,"threads_started":1}
I20260811 10:06:03.916342 28599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:03.905539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39495 (local address 127.9.127.193:40777)
0811 10:06:03.905592 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:03.905604 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:03.905671 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:03.906647 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:03.906650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:03.907036 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:03.907228 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:03.907234 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:03.908374 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:03.908375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:03.909324 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:03.909327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:03.909965 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:03.909966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:03.910052 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:03.910729 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:03.910734 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:03.912676 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:03.914882 (+ 2206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:03.914883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:03.914884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:03.915071 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:03.915377 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:03.915378 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:03.915378 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:03.915450 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:03.915871 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:03.915873 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:03.915923 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 10:06:03.916016 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 10:06:03.916174 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":98}
I20260811 10:06:03.916700 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:03.905656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:40777 (local address 127.9.127.194:39495)
0811 10:06:03.905948 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:03.905958 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:03.905988 (+ 30us) server_negotiation.cc:407] Connection header received
0811 10:06:03.906418 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:03.906421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:03.906458 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:03.906622 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:03.907388 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:03.908253 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:03.909442 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:03.909849 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:03.909993 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:03.912802 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:03.912815 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:03.912815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:03.912826 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:03.914794 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:03.915176 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:03.915179 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:03.915180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:03.915285 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:03.915531 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:03.915532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:03.915532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:03.915779 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:03.915875 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:03.916085 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 10:06:03.916217 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":76,"threads_started":1}
W20260811 10:06:03.917407 28185 leader_election.cc:341] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689): Not found: Tablet not found: 582637b364f44d45a63cd8823936ea55
W20260811 10:06:03.917481 28184 leader_election.cc:341] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495): Not found: Tablet not found: 582637b364f44d45a63cd8823936ea55
I20260811 10:06:03.917513 28185 leader_election.cc:302] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d2cc5f45b44d6abec7b4ebcb6637fa; no voters: 44d31476c9874fdd9827a0452e9ade31, 67c65c18b57e4587b51de2c71106a8f1
I20260811 10:06:03.917634 28602 raft_consensus.cc:2726] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:06:04.417383 28607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:04.417180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:44499)
0811 10:06:04.417297 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:04.417336 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
I20260811 10:06:04.494025 28608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:04.493822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:59633)
0811 10:06:04.493943 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:04.493985 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260811 10:06:04.619027 28609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:04.618841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:43863)
0811 10:06:04.618961 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:04.618996 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260811 10:06:05.418120 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:05.417887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:45411)
0811 10:06:05.418032 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:05.418067 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260811 10:06:05.494818 28611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:05.494585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:49937)
0811 10:06:05.494742 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:05.494779 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":80,"threads_started":1}
I20260811 10:06:05.561010 28612 raft_consensus.cc:482] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:05.561133 28612 raft_consensus.cc:504] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:06:05.561357 28612 leader_election.cc:288] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495), 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689)
W20260811 10:06:05.561779 28185 leader_election.cc:341] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689): Not found: Tablet not found: 582637b364f44d45a63cd8823936ea55
W20260811 10:06:05.561879 28184 leader_election.cc:341] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495): Not found: Tablet not found: 582637b364f44d45a63cd8823936ea55
I20260811 10:06:05.561957 28184 leader_election.cc:302] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d2cc5f45b44d6abec7b4ebcb6637fa; no voters: 44d31476c9874fdd9827a0452e9ade31, 67c65c18b57e4587b51de2c71106a8f1
I20260811 10:06:05.562050 28612 raft_consensus.cc:2726] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:06:05.619663 28613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:05.619479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:58107)
0811 10:06:05.619595 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:05.619626 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
I20260811 10:06:06.418849 28614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:06.418603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:49303)
0811 10:06:06.418759 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:06.418800 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":72,"threads_started":1}
I20260811 10:06:06.495499 28615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:06.495297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:55323)
0811 10:06:06.495431 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:06.495464 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260811 10:06:06.620328 28616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:06.620124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:51673)
0811 10:06:06.620254 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:06.620290 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":63,"threads_started":1}
I20260811 10:06:07.419725 28617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:07.419498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:58293)
0811 10:06:07.419644 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:07.419680 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260811 10:06:07.496138 28618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:07.495944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:43323)
0811 10:06:07.496064 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:07.496100 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260811 10:06:07.621039 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:07.620833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:60739)
0811 10:06:07.620954 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:07.620997 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260811 10:06:08.420410 28621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:08.420211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:33349)
0811 10:06:08.420332 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:08.420364 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260811 10:06:08.496851 28622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:08.496575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:37119)
0811 10:06:08.496717 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:08.496753 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260811 10:06:08.621609 28623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:08.621411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:46613)
0811 10:06:08.621538 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:08.621572 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260811 10:06:08.735747 28624 raft_consensus.cc:482] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:08.735838 28624 raft_consensus.cc:504] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:06:08.736052 28624 leader_election.cc:288] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495), 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689)
W20260811 10:06:08.736469 28185 leader_election.cc:341] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689): Not found: Tablet not found: 582637b364f44d45a63cd8823936ea55
W20260811 10:06:08.736550 28184 leader_election.cc:341] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495): Not found: Tablet not found: 582637b364f44d45a63cd8823936ea55
I20260811 10:06:08.736614 28184 leader_election.cc:302] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d2cc5f45b44d6abec7b4ebcb6637fa; no voters: 44d31476c9874fdd9827a0452e9ade31, 67c65c18b57e4587b51de2c71106a8f1
I20260811 10:06:08.736721 28624 raft_consensus.cc:2726] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:06:09.421231 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:09.420989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:48841)
0811 10:06:09.421131 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:09.421181 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
I20260811 10:06:09.497519 28626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:09.497318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:48545)
0811 10:06:09.497443 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:09.497478 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260811 10:06:09.622263 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:09.622054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:59159)
0811 10:06:09.622189 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:09.622228 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":92,"threads_started":1}
I20260811 10:06:10.421934 28629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:10.421729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:39043)
0811 10:06:10.421851 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:10.421887 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260811 10:06:10.498198 28630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:10.497957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:42073)
0811 10:06:10.498106 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:10.498154 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":62,"threads_started":1}
I20260811 10:06:10.622920 28631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:10.622633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:44793)
0811 10:06:10.622839 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:10.622881 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":61,"threads_started":1}
I20260811 10:06:11.422724 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:11.422469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:43759)
0811 10:06:11.422600 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:11.422639 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260811 10:06:11.498858 28633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:11.498652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:34005)
0811 10:06:11.498786 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:11.498821 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":61,"threads_started":1}
I20260811 10:06:11.623620 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:11.623376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:46121)
0811 10:06:11.623543 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:11.623584 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":73,"threads_started":1}
I20260811 10:06:12.423600 28635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:12.423336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:60611)
0811 10:06:12.423504 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:12.423550 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":70,"threads_started":1}
I20260811 10:06:12.499552 28636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:12.499313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:47887)
0811 10:06:12.499462 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:12.499508 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260811 10:06:12.624398 28637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:12.624050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:51471)
0811 10:06:12.624320 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:12.624360 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":70,"threads_started":1}
I20260811 10:06:13.156064 28638 raft_consensus.cc:482] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:13.156213 28638 raft_consensus.cc:504] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44d31476c9874fdd9827a0452e9ade31" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39495 } } peers { permanent_uuid: "67c65c18b57e4587b51de2c71106a8f1" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43689 } } peers { permanent_uuid: "77d2cc5f45b44d6abec7b4ebcb6637fa" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36225 } }
I20260811 10:06:13.156430 28638 leader_election.cc:288] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495), 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689)
W20260811 10:06:13.156898 28184 leader_election.cc:341] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 44d31476c9874fdd9827a0452e9ade31 (127.9.127.194:39495): Not found: Tablet not found: 582637b364f44d45a63cd8823936ea55
W20260811 10:06:13.157023 28185 leader_election.cc:341] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67c65c18b57e4587b51de2c71106a8f1 (127.9.127.195:43689): Not found: Tablet not found: 582637b364f44d45a63cd8823936ea55
I20260811 10:06:13.157094 28185 leader_election.cc:302] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d2cc5f45b44d6abec7b4ebcb6637fa; no voters: 44d31476c9874fdd9827a0452e9ade31, 67c65c18b57e4587b51de2c71106a8f1
I20260811 10:06:13.157182 28638 raft_consensus.cc:2726] T 582637b364f44d45a63cd8823936ea55 P 77d2cc5f45b44d6abec7b4ebcb6637fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 10:06:13.424322 28639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:13.424055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:41075)
0811 10:06:13.424213 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:13.424250 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
I20260811 10:06:13.500198 28640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:13.499993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:33713)
0811 10:06:13.500112 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:13.500149 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260811 10:06:13.625134 28641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:13.624903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:60163)
0811 10:06:13.625043 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:13.625081 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260811 10:06:14.425036 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:14.424758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:44519)
0811 10:06:14.424937 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:14.424969 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":114,"threads_started":1}
I20260811 10:06:14.500962 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:14.500684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:46969)
0811 10:06:14.500858 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:14.500911 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":105,"threads_started":1}
I20260811 10:06:14.625825 28644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:14.625624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:42387)
0811 10:06:14.625750 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:14.625785 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260811 10:06:15.425714 28645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:15.425478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:53461)
0811 10:06:15.425629 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:15.425665 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":64,"threads_started":1}
I20260811 10:06:15.501581 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:15.501363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:49285)
0811 10:06:15.501501 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:15.501539 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260811 10:06:15.626453 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:15.626265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:44855)
0811 10:06:15.626379 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:15.626413 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260811 10:06:16.426364 28649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:16.426145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:57437)
0811 10:06:16.426278 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:16.426316 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260811 10:06:16.502346 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:16.502115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:35639)
0811 10:06:16.502263 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:16.502307 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":73,"threads_started":1}
I20260811 10:06:16.627086 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:16.626898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:60641)
0811 10:06:16.627011 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:16.627047 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260811 10:06:17.427030 28652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:17.426837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.193:56829)
0811 10:06:17.426952 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:17.426984 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260811 10:06:17.503136 28655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:17.502912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.194:41987)
0811 10:06:17.503056 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:17.503099 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260811 10:06:17.627740 28656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:17.627535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:33125 (local address 127.9.127.195:47937)
0811 10:06:17.627667 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:17.627699 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.254:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260811 10:06:17.631489 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 28129
I20260811 10:06:17.638413 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 28308
I20260811 10:06:17.645583 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 28450
2026-08-11T10:06:17Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58504 ms)
[----------] 30 tests from SecurityITest (234179 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:17 dist-test-slave-1x4g krb5kdc[28659](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:17 dist-test-slave-1x4g krb5kdc[28659](info): set up 2 sockets
Aug 11 10:06:17 dist-test-slave-1x4g krb5kdc[28659](info): commencing operation
krb5kdc: starting...
W20260811 10:06:18.712561 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:18 dist-test-slave-1x4g krb5kdc[28659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:18.831827 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37517
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:37517
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:18.911293 28672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:18.911516 28672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:18.911554 28672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:18.912678 28672 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:18.912742 28672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:18.912766 28672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:18.912789 28672 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:18.912863 28672 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:18.914300 28672 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:37517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:18.914569 28672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:18.914779 28672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:18.919445 28678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:18.919449 28677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:18.919449 28680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:18.919699 28672 server_base.cc:1034] running on GCE node
I20260811 10:06:18.919871 28672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:18.920142 28672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:18.921283 28672 hybrid_clock.cc:648] HybridClock initialized: now 1786442778921238 us; error 59 us; skew 500 ppm
Aug 11 10:06:18 dist-test-slave-1x4g krb5kdc[28659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442778, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:18.923679 28672 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:18.924100 28672 webserver.cc:460] Webserver started at http://127.9.127.254:42401/ using document root <none> and password file <none>
I20260811 10:06:18.924319 28672 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:18.924362 28672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:18.924530 28672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:18.925637 28672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "b055929893054954a1bb3629744d5b0f"
format_stamp: "Formatted at 2026-08-11 10:06:18 on dist-test-slave-1x4g"
server_key: "1a57a0fbe18f42d585ee99c1c2396cf2"
server_key_iv: "a6713bdc124b7bbc300a8f5658a84135"
server_key_version: "encryptionkey@0"
I20260811 10:06:18.926007 28672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "b055929893054954a1bb3629744d5b0f"
format_stamp: "Formatted at 2026-08-11 10:06:18 on dist-test-slave-1x4g"
server_key: "1a57a0fbe18f42d585ee99c1c2396cf2"
server_key_iv: "a6713bdc124b7bbc300a8f5658a84135"
server_key_version: "encryptionkey@0"
I20260811 10:06:18.927433 28672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:06:18.928143 28687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:18.928309 28672 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:18.928411 28672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "b055929893054954a1bb3629744d5b0f"
format_stamp: "Formatted at 2026-08-11 10:06:18 on dist-test-slave-1x4g"
server_key: "1a57a0fbe18f42d585ee99c1c2396cf2"
server_key_iv: "a6713bdc124b7bbc300a8f5658a84135"
server_key_version: "encryptionkey@0"
I20260811 10:06:18.928490 28672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:18.937031 28672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:18.938665 28672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:18.938815 28672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:18.942781 28672 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:37517
I20260811 10:06:18.942833 28742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:37517 every 8 connection(s)
I20260811 10:06:18.943186 28672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:18.943995 28743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:18.946201 28743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f: Bootstrap starting.
I20260811 10:06:18.946779 28743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:18.947088 28743 log.cc:824] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:18.947178 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 28672
I20260811 10:06:18.947291 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:18.947491 9727 external_mini_cluster.cc:1428] Setting key 307d8ad1cba568ffafc4b3ebe81346d8
I20260811 10:06:18.947878 28743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f: No bootstrap required, opened a new log
I20260811 10:06:18.949946 28743 raft_consensus.cc:348] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b055929893054954a1bb3629744d5b0f" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37517 } }
I20260811 10:06:18.950105 28743 raft_consensus.cc:374] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:18.950171 28743 raft_consensus.cc:729] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b055929893054954a1bb3629744d5b0f, State: Initialized, Role: FOLLOWER
I20260811 10:06:18.950340 28743 consensus_queue.cc:260] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b055929893054954a1bb3629744d5b0f" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37517 } }
I20260811 10:06:18.950431 28743 raft_consensus.cc:388] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:18.950466 28743 raft_consensus.cc:482] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:18.950507 28743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:18.951486 28743 raft_consensus.cc:504] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b055929893054954a1bb3629744d5b0f" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37517 } }
I20260811 10:06:18.951615 28743 leader_election.cc:302] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b055929893054954a1bb3629744d5b0f; no voters:
I20260811 10:06:18.951795 28743 leader_election.cc:288] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:18.951820 28748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:18.951931 28748 raft_consensus.cc:686] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [term 1 LEADER]: Becoming Leader. State: Replica: b055929893054954a1bb3629744d5b0f, State: Running, Role: LEADER
I20260811 10:06:18.952059 28743 sys_catalog.cc:564] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:18.952081 28748 consensus_queue.cc:237] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b055929893054954a1bb3629744d5b0f" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37517 } }
I20260811 10:06:18.952507 28749 sys_catalog.cc:455] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b055929893054954a1bb3629744d5b0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b055929893054954a1bb3629744d5b0f" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37517 } } }
I20260811 10:06:18.952521 28750 sys_catalog.cc:455] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b055929893054954a1bb3629744d5b0f. Latest consensus state: current_term: 1 leader_uuid: "b055929893054954a1bb3629744d5b0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b055929893054954a1bb3629744d5b0f" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37517 } } }
I20260811 10:06:18.952610 28749 sys_catalog.cc:458] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:18.952630 28750 sys_catalog.cc:458] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:18.953142 28756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:18.953778 28756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:18.955435 28756 catalog_manager.cc:1347] Generated new cluster ID: 798a11e09db54b528586b9aac6ab4e56
I20260811 10:06:18.955484 28756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:06:18 dist-test-slave-1x4g krb5kdc[28659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:18.960712 28756 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:18.961066 28747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:18.947989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35082 (local address 127.9.127.254:37517)
0811 10:06:18.948169 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:18.948176 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:18.948199 (+ 23us) server_negotiation.cc:407] Connection header received
0811 10:06:18.949933 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:18.949942 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:18.949993 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:18.950111 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:18.950989 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:18.952026 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:18.953174 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:18.953791 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:18.954201 (+ 410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:18.956729 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:18.956733 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:18.956733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:18.956745 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:18.958701 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:18.959129 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:18.959132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:18.959132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:18.959262 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:18.959502 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:18.959503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:18.959503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:18.959798 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:18.960385 (+ 587us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:18.960471 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 10:06:18.960617 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260811 10:06:18.961337 28756 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:18.968920 28756 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f: Generated new TSK 0
I20260811 10:06:18.969149 28756 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:06:19.005955 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37517
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:19.094848 28769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:19.095048 28769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:19.095070 28769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:19.096186 28769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:19.096230 28769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:19.096256 28769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:06:19.097744 28769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:19.097982 28769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:19.098301 28769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:19.103127 28774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.103145 28775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.103145 28777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:19.103494 28769 server_base.cc:1034] running on GCE node
I20260811 10:06:19.103714 28769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:19.103962 28769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:19.105125 28769 hybrid_clock.cc:648] HybridClock initialized: now 1786442779105110 us; error 28 us; skew 500 ppm
Aug 11 10:06:19 dist-test-slave-1x4g krb5kdc[28659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442779, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:19.107496 28769 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:06:19.107909 28769 webserver.cc:460] Webserver started at http://127.9.127.193:33281/ using document root <none> and password file <none>
I20260811 10:06:19.108142 28769 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:19.108208 28769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:19.108355 28769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:19.109377 28769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "945b6961a38245849b7661ba080dde67"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "d13d44bb9ac9cc5101771e9f20e78243"
server_key_iv: "6b570b25ff818bb3b4824893e299ef8b"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.109740 28769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "945b6961a38245849b7661ba080dde67"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "d13d44bb9ac9cc5101771e9f20e78243"
server_key_iv: "6b570b25ff818bb3b4824893e299ef8b"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.111171 28769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:19.111908 28784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.112074 28769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:19.112175 28769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "945b6961a38245849b7661ba080dde67"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "d13d44bb9ac9cc5101771e9f20e78243"
server_key_iv: "6b570b25ff818bb3b4824893e299ef8b"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.112247 28769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:19.127604 28769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:19.129355 28769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:19.129458 28769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:19.129622 28769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:19.129920 28769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:19.129971 28769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.130000 28769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:19.130029 28769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.135910 28769 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:34867
I20260811 10:06:19.136005 28905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:34867 every 8 connection(s)
I20260811 10:06:19.136283 28769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:06:19.141831 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 28769
I20260811 10:06:19.141970 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:06:19.142210 9727 external_mini_cluster.cc:1428] Setting key fb176e91b0e3e67b2b5d34b50acda869
Aug 11 10:06:19 dist-test-slave-1x4g krb5kdc[28659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442779, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:19.145884 28747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.137054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:54107 (local address 127.9.127.254:37517)
0811 10:06:19.137113 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.137115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.137318 (+ 203us) server_negotiation.cc:407] Connection header received
0811 10:06:19.137836 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.137837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.137853 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.137904 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:19.138809 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.139340 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.140348 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.140564 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.140642 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.142880 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:19.142882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:19.142882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:19.142893 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:19.144334 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:19.144910 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:19.144911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:19.144911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:19.144967 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:19.145273 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:19.145273 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:19.145273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:19.145377 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:19.145424 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.145744 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.145820 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 10:06:19.146175 28908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.137045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37517 (local address 127.9.127.193:54107)
0811 10:06:19.137204 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.137239 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.137719 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.137976 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.137980 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.138523 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:19.138695 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.138699 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.139437 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.139438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.140238 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.140240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.140651 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.140652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.140817 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.141315 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:19.141323 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:19.142779 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:19.144457 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:19.144465 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:19.144468 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:19.144799 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:19.145049 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:19.145050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:19.145050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:19.145198 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:19.145438 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:19.145444 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:19.145602 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.145730 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.145909 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260811 10:06:19.146724 28906 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37517
I20260811 10:06:19.146811 28906 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:19.146992 28906 heartbeater.cc:511] Master 127.9.127.254:37517 requested a full tablet report, sending...
I20260811 10:06:19.147497 28706 ts_manager.cc:194] Registered new tserver with Master: 945b6961a38245849b7661ba080dde67 (127.9.127.193:34867)
I20260811 10:06:19.148101 28706 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:54107
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:06:19.168237 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37517
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:19.247691 28911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:19.247927 28911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:19.247962 28911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:19.249061 28911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:19.249126 28911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:19.249171 28911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:06:19.250591 28911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:19.250862 28911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:19.251086 28911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:19.256135 28916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.256160 28917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.256140 28919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:19.256667 28911 server_base.cc:1034] running on GCE node
I20260811 10:06:19.256904 28911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:19.257154 28911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:19.258320 28911 hybrid_clock.cc:648] HybridClock initialized: now 1786442779258305 us; error 47 us; skew 500 ppm
Aug 11 10:06:19 dist-test-slave-1x4g krb5kdc[28659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442779, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:19.260711 28911 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:06:19.261229 28911 webserver.cc:460] Webserver started at http://127.9.127.194:44477/ using document root <none> and password file <none>
I20260811 10:06:19.261488 28911 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:19.261566 28911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:19.261723 28911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:19.262804 28911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "a812aec84fed44b19c38170c3b5c5ab2"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "e0a60bc5a903945e9928be845f62b6ba"
server_key_iv: "179a696a31801a7c6533b636e35684ae"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.263157 28911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "a812aec84fed44b19c38170c3b5c5ab2"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "e0a60bc5a903945e9928be845f62b6ba"
server_key_iv: "179a696a31801a7c6533b636e35684ae"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.264441 28911 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:19.265209 28926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.265379 28911 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.265491 28911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "a812aec84fed44b19c38170c3b5c5ab2"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "e0a60bc5a903945e9928be845f62b6ba"
server_key_iv: "179a696a31801a7c6533b636e35684ae"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.265568 28911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:19.285100 28911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:19.286810 28911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:19.286967 28911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:19.287181 28911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:19.287488 28911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:19.287549 28911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.287588 28911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:19.287616 28911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.293489 28911 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:43847
I20260811 10:06:19.293538 29050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:43847 every 8 connection(s)
I20260811 10:06:19.293836 28911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:06:19 dist-test-slave-1x4g krb5kdc[28659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442779, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:19.302279 28747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.294516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:40201 (local address 127.9.127.254:37517)
0811 10:06:19.294580 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.294583 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.294754 (+ 171us) server_negotiation.cc:407] Connection header received
0811 10:06:19.295195 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.295196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.295207 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.295260 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:19.296096 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.296617 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.297621 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.297805 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.297869 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.299800 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:19.299802 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:19.299802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:19.299809 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:19.301117 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:19.301510 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:19.301511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:19.301511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:19.301560 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:19.301789 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:19.301790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:19.301790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:19.301883 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:19.301931 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.302153 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.302219 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 10:06:19.302414 29053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.294477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37517 (local address 127.9.127.194:40201)
0811 10:06:19.294629 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.294668 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.295114 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.295310 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.295312 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.295834 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:19.296011 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.296015 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.296710 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.296710 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.297542 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.297545 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.297888 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.297889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.297987 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.298362 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:19.298370 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:19.299714 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:19.301200 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:19.301207 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:19.301209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:19.301430 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:19.301634 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:19.301635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:19.301635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:19.301734 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:19.301939 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:19.301944 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:19.302043 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.302118 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.302227 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
I20260811 10:06:19.302920 29051 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37517
I20260811 10:06:19.303031 29051 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:19.303228 29051 heartbeater.cc:511] Master 127.9.127.254:37517 requested a full tablet report, sending...
I20260811 10:06:19.303241 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 28911
I20260811 10:06:19.303344 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:06:19.303555 9727 external_mini_cluster.cc:1428] Setting key ca8c21ef8329be74b30294ae75489c90
I20260811 10:06:19.303679 28706 ts_manager.cc:194] Registered new tserver with Master: a812aec84fed44b19c38170c3b5c5ab2 (127.9.127.194:43847)
I20260811 10:06:19.304066 28706 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:40201
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:06:19.330945 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37517
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:19.412461 29056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:19.412662 29056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:19.412683 29056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:19.413813 29056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:19.413854 29056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:19.413906 29056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:06:19.415396 29056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:37517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:19.415632 29056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:19.415853 29056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:19.420750 29064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.420729 29061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.420768 29062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:19.421043 29056 server_base.cc:1034] running on GCE node
I20260811 10:06:19.421255 29056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:19.421504 29056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:19.422669 29056 hybrid_clock.cc:648] HybridClock initialized: now 1786442779422664 us; error 36 us; skew 500 ppm
Aug 11 10:06:19 dist-test-slave-1x4g krb5kdc[28659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442779, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:19.425228 29056 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:06:19.425670 29056 webserver.cc:460] Webserver started at http://127.9.127.195:45679/ using document root <none> and password file <none>
I20260811 10:06:19.425856 29056 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:19.425894 29056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:19.425980 29056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:19.426951 29056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "e85625c7ee8c45e7bc50eacfa755cd79"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "7365f88981bbb0c96bcc6d35cb5a7b4a"
server_key_iv: "72f8ca2e3470fe75abc9e0f6d7c045d8"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.427251 29056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "e85625c7ee8c45e7bc50eacfa755cd79"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "7365f88981bbb0c96bcc6d35cb5a7b4a"
server_key_iv: "72f8ca2e3470fe75abc9e0f6d7c045d8"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.428571 29056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:19.429265 29071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.429430 29056 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.429512 29056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "e85625c7ee8c45e7bc50eacfa755cd79"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "7365f88981bbb0c96bcc6d35cb5a7b4a"
server_key_iv: "72f8ca2e3470fe75abc9e0f6d7c045d8"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.429590 29056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:19.441335 29056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:19.443475 29056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:19.443634 29056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:19.443847 29056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:19.444141 29056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:19.444195 29056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.444234 29056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:19.444275 29056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.449949 29056 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:44039
I20260811 10:06:19.450016 29195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:44039 every 8 connection(s)
I20260811 10:06:19.450312 29056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:06:19.456020 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 29056
I20260811 10:06:19.456143 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:06:19.456350 9727 external_mini_cluster.cc:1428] Setting key 594fd2a3ab919ae341e6471fe1705160
Aug 11 10:06:19 dist-test-slave-1x4g krb5kdc[28659](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442779, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:19.459972 28747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.451045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:47583 (local address 127.9.127.254:37517)
0811 10:06:19.451103 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.451106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.451285 (+ 179us) server_negotiation.cc:407] Connection header received
0811 10:06:19.451872 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.451873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.451887 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.451935 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:19.453129 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.453725 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.454841 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.455054 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.455137 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.457386 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:19.457388 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:19.457388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:19.457396 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:19.458589 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:19.459001 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:19.459002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:19.459002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:19.459067 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:19.459322 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:19.459323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:19.459324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:19.459446 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:19.459528 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.459806 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.459885 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 10:06:19.460145 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.450983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:37517 (local address 127.9.127.195:47583)
0811 10:06:19.451171 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.451204 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.451763 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.451998 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.452002 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.452650 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:19.453033 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.453038 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.453817 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.453818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.454750 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.454753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.455151 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.455152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.455297 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.455674 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:19.455681 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:19.457312 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:19.458672 (+ 1360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:19.458679 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:19.458682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:19.458895 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:19.459137 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:19.459138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:19.459139 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:19.459252 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:19.459519 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:19.459526 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:19.459661 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.459769 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.459929 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":73,"threads_started":1}
I20260811 10:06:19.460585 29197 heartbeater.cc:347] Connected to a master server at 127.9.127.254:37517
I20260811 10:06:19.460675 29197 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:19.460850 29197 heartbeater.cc:511] Master 127.9.127.254:37517 requested a full tablet report, sending...
I20260811 10:06:19.461194 28706 ts_manager.cc:194] Registered new tserver with Master: e85625c7ee8c45e7bc50eacfa755cd79 (127.9.127.195:44039)
I20260811 10:06:19.461562 28706 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:47583
I20260811 10:06:19.467936 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:06:19.474995 28747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.469397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44140 (local address 127.9.127.254:37517)
0811 10:06:19.469441 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.469444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.469561 (+ 117us) server_negotiation.cc:407] Connection header received
0811 10:06:19.469625 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.469627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.469638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.469692 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:19.470257 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.470744 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.471469 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.471678 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.471776 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.472840 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:19.472841 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:19.472841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:19.472848 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:19.473886 (+ 1038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:19.474221 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:19.474222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:19.474222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:19.474279 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:19.474478 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:19.474479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:19.474479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:19.474616 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:19.474717 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.474827 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.474903 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:06:19.476521 28706 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:06:19.478183 28706 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:06:19.484493 29208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.480369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:34867 (local address 127.0.0.1:46204)
0811 10:06:19.480692 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.480735 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.480835 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.481095 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.481097 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.481099 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:19.481188 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.481190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.482277 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.482278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.483282 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.483284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.484202 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.484203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.484281 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.484294 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.484359 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.484412 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":51,"threads_started":1}
I20260811 10:06:19.484602 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.480508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50332 (local address 127.9.127.194:43847)
0811 10:06:19.481231 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.481235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.481244 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:06:19.481282 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.481284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.481302 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.481380 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:19.481508 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.482593 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.483689 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.484267 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.484338 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.484385 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.484484 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.484526 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":98,"threads_started":1}
I20260811 10:06:19.484844 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.480484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46204 (local address 127.9.127.193:34867)
0811 10:06:19.480911 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.480916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.480925 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:06:19.480962 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.480966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.481001 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.481059 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:19.481262 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.482182 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.483394 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.484118 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.484199 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.484257 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.484672 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.484723 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":88,"threads_started":1}
I20260811 10:06:19.484588 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.480382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:43847 (local address 127.0.0.1:50332)
0811 10:06:19.480709 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.480741 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.480819 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.481378 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.481379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.481381 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:19.481426 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.481427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.482696 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.482697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.483606 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.483608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.484336 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.484337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.484401 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.484404 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.484456 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.484485 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":74,"threads_started":1}
I20260811 10:06:19.485352 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.480565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:44039 (local address 127.0.0.1:37280)
0811 10:06:19.481480 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.481490 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.481547 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.481716 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.481717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.481719 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:19.481756 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.481757 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.482842 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.482844 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.483913 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.483916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.485095 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.485097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.485171 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.485175 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.485233 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.485279 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":897,"thread_start_us":81,"threads_started":1}
I20260811 10:06:19.485369 29213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.480659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37280 (local address 127.9.127.195:44039)
0811 10:06:19.480880 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.480885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.481545 (+ 660us) server_negotiation.cc:407] Connection header received
0811 10:06:19.481611 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.481613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.481629 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.481707 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:19.481816 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.482740 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.484006 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.485010 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.485084 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.485139 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.485257 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.485299 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":98,"threads_started":1}
I20260811 10:06:19.485675 28836 tablet_service.cc:1467] Processing CreateTablet for tablet aaa30d9ba5ae422389af81264f3dec69 (DEFAULT_TABLE table=test-table [id=ece9a9bee2294b7080c2f42c16610af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:19.485927 28977 tablet_service.cc:1467] Processing CreateTablet for tablet aaa30d9ba5ae422389af81264f3dec69 (DEFAULT_TABLE table=test-table [id=ece9a9bee2294b7080c2f42c16610af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:19.486078 28836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaa30d9ba5ae422389af81264f3dec69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:19.486271 28977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaa30d9ba5ae422389af81264f3dec69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:19.489523 29215 tablet_bootstrap.cc:492] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67: Bootstrap starting.
I20260811 10:06:19.489614 29214 tablet_bootstrap.cc:492] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Bootstrap starting.
I20260811 10:06:19.490136 29123 tablet_service.cc:1467] Processing CreateTablet for tablet aaa30d9ba5ae422389af81264f3dec69 (DEFAULT_TABLE table=test-table [id=ece9a9bee2294b7080c2f42c16610af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:19.490232 29215 tablet_bootstrap.cc:654] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:19.490231 29214 tablet_bootstrap.cc:654] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:19.490437 29123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaa30d9ba5ae422389af81264f3dec69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:19.490849 29215 log.cc:824] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:19.490849 29214 log.cc:824] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:19.491621 29215 tablet_bootstrap.cc:492] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67: No bootstrap required, opened a new log
I20260811 10:06:19.491695 29215 ts_tablet_manager.cc:1397] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:06:19.491878 29214 tablet_bootstrap.cc:492] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: No bootstrap required, opened a new log
I20260811 10:06:19.491942 29214 ts_tablet_manager.cc:1397] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:06:19.493376 29218 tablet_bootstrap.cc:492] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: Bootstrap starting.
I20260811 10:06:19.493763 29215 raft_consensus.cc:348] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.493827 29214 raft_consensus.cc:348] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.493957 29214 raft_consensus.cc:374] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:19.493954 29215 raft_consensus.cc:374] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:19.493978 29218 tablet_bootstrap.cc:654] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:19.493992 29215 raft_consensus.cc:729] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 945b6961a38245849b7661ba080dde67, State: Initialized, Role: FOLLOWER
I20260811 10:06:19.493992 29214 raft_consensus.cc:729] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a812aec84fed44b19c38170c3b5c5ab2, State: Initialized, Role: FOLLOWER
I20260811 10:06:19.494120 29215 consensus_queue.cc:260] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.494155 29214 consensus_queue.cc:260] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.494413 29215 ts_tablet_manager.cc:1428] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:06:19.494413 29214 ts_tablet_manager.cc:1428] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 10:06:19.494535 29051 heartbeater.cc:503] Master 127.9.127.254:37517 was elected leader, sending a full tablet report...
I20260811 10:06:19.494553 28906 heartbeater.cc:503] Master 127.9.127.254:37517 was elected leader, sending a full tablet report...
I20260811 10:06:19.494589 29218 log.cc:824] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:19.495489 29218 tablet_bootstrap.cc:492] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: No bootstrap required, opened a new log
I20260811 10:06:19.495561 29218 ts_tablet_manager.cc:1397] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:06:19.497185 29218 raft_consensus.cc:348] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.497335 29218 raft_consensus.cc:374] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:19.497382 29218 raft_consensus.cc:729] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e85625c7ee8c45e7bc50eacfa755cd79, State: Initialized, Role: FOLLOWER
I20260811 10:06:19.497502 29218 consensus_queue.cc:260] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.497766 29218 ts_tablet_manager.cc:1428] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:06:19.497815 29197 heartbeater.cc:503] Master 127.9.127.254:37517 was elected leader, sending a full tablet report...
W20260811 10:06:19.544471 29052 tablet.cc:2369] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:06:19.551513 29220 raft_consensus.cc:482] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:19.551607 29220 raft_consensus.cc:504] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.551935 29220 leader_election.cc:288] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 945b6961a38245849b7661ba080dde67 (127.9.127.193:34867), e85625c7ee8c45e7bc50eacfa755cd79 (127.9.127.195:44039)
I20260811 10:06:19.555027 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.552204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:60167 (local address 127.9.127.193:34867)
0811 10:06:19.552271 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.552274 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.552285 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:06:19.552319 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.552319 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.552335 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.552412 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:19.552604 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.553280 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.554295 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.554679 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.554766 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.554775 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.554929 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.554965 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 10:06:19.555028 29053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.552119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:34867 (local address 127.9.127.194:60167)
0811 10:06:19.552176 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.552188 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.552230 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.552421 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.552422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.552424 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:19.552526 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.552528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.553370 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.553371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.554204 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.554207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.554766 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.554767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.554852 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.554855 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.554921 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.554961 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":26}
I20260811 10:06:19.555104 29213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.552344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:54845 (local address 127.9.127.195:44039)
0811 10:06:19.552412 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.552414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.552501 (+ 87us) server_negotiation.cc:407] Connection header received
0811 10:06:19.552536 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.552538 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.552547 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.552598 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:19.552838 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.553385 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.554373 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.554744 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.554828 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.554836 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.554993 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.555029 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 10:06:19.555260 29224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.552246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:44039 (local address 127.9.127.194:54845)
0811 10:06:19.552427 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.552438 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.552492 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.552612 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.552613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.552614 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:19.552725 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.552727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.553471 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.553472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.554285 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.554287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.554828 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.554829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.554911 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.554915 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.554980 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.555021 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":117,"threads_started":1}
I20260811 10:06:19.555424 28859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aaa30d9ba5ae422389af81264f3dec69" candidate_uuid: "a812aec84fed44b19c38170c3b5c5ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "945b6961a38245849b7661ba080dde67" is_pre_election: true
I20260811 10:06:19.555603 28859 raft_consensus.cc:2454] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a812aec84fed44b19c38170c3b5c5ab2 in term 0.
I20260811 10:06:19.555585 29144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aaa30d9ba5ae422389af81264f3dec69" candidate_uuid: "a812aec84fed44b19c38170c3b5c5ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" is_pre_election: true
I20260811 10:06:19.555769 29144 raft_consensus.cc:2454] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a812aec84fed44b19c38170c3b5c5ab2 in term 0.
I20260811 10:06:19.555840 28929 leader_election.cc:302] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 945b6961a38245849b7661ba080dde67, a812aec84fed44b19c38170c3b5c5ab2; no voters:
I20260811 10:06:19.555979 29220 raft_consensus.cc:2781] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:06:19.556066 29220 raft_consensus.cc:482] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:06:19.556092 29220 raft_consensus.cc:3037] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:19.556871 29220 raft_consensus.cc:504] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.557004 29220 leader_election.cc:288] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [CANDIDATE]: Term 1 election: Requested vote from peers 945b6961a38245849b7661ba080dde67 (127.9.127.193:34867), e85625c7ee8c45e7bc50eacfa755cd79 (127.9.127.195:44039)
I20260811 10:06:19.557149 28859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aaa30d9ba5ae422389af81264f3dec69" candidate_uuid: "a812aec84fed44b19c38170c3b5c5ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "945b6961a38245849b7661ba080dde67"
I20260811 10:06:19.557176 29144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aaa30d9ba5ae422389af81264f3dec69" candidate_uuid: "a812aec84fed44b19c38170c3b5c5ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e85625c7ee8c45e7bc50eacfa755cd79"
I20260811 10:06:19.557248 29144 raft_consensus.cc:3037] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:19.557258 28859 raft_consensus.cc:3037] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:19.557978 29144 raft_consensus.cc:2454] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a812aec84fed44b19c38170c3b5c5ab2 in term 1.
I20260811 10:06:19.558136 28859 raft_consensus.cc:2454] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a812aec84fed44b19c38170c3b5c5ab2 in term 1.
I20260811 10:06:19.558140 28929 leader_election.cc:302] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a812aec84fed44b19c38170c3b5c5ab2, e85625c7ee8c45e7bc50eacfa755cd79; no voters:
I20260811 10:06:19.558259 29220 raft_consensus.cc:2781] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:19.558411 29220 raft_consensus.cc:686] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 1 LEADER]: Becoming Leader. State: Replica: a812aec84fed44b19c38170c3b5c5ab2, State: Running, Role: LEADER
I20260811 10:06:19.558516 29220 consensus_queue.cc:237] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } }
I20260811 10:06:19.559302 28706 catalog_manager.cc:5495] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a812aec84fed44b19c38170c3b5c5ab2 (127.9.127.194). New cstate: current_term: 1 leader_uuid: "a812aec84fed44b19c38170c3b5c5ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a812aec84fed44b19c38170c3b5c5ab2" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 43847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 } health_report { overall_health: UNKNOWN } } }
I20260811 10:06:19.575352 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.572976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50346 (local address 127.9.127.194:43847)
0811 10:06:19.573017 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.573019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.573029 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:19.573114 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.573115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.573137 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.573211 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:19.573353 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.573829 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.574585 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.574774 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.574849 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.575008 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:19.575111 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:19.575204 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.575229 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.575248 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:06:19.577108 28859 raft_consensus.cc:1261] T aaa30d9ba5ae422389af81264f3dec69 P 945b6961a38245849b7661ba080dde67 [term 1 FOLLOWER]: Refusing update from remote peer a812aec84fed44b19c38170c3b5c5ab2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:19.577108 29144 raft_consensus.cc:1261] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 1 FOLLOWER]: Refusing update from remote peer a812aec84fed44b19c38170c3b5c5ab2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:19.577503 29220 consensus_queue.cc:1035] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e85625c7ee8c45e7bc50eacfa755cd79" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:19.577636 29225 consensus_queue.cc:1035] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "945b6961a38245849b7661ba080dde67" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:19.580957 29229 mvcc.cc:205] Tried to move back new op lower bound from 7317269625144922112 to 7317269625072209920. Current Snapshot: MvccSnapshot[applied={T|T < 7317269625144922112}]
I20260811 10:06:19.581174 29230 mvcc.cc:205] Tried to move back new op lower bound from 7317269625144922112 to 7317269625072209920. Current Snapshot: MvccSnapshot[applied={T|T < 7317269625144922112 or (T in {7317269625144922112})}]
I20260811 10:06:19.582370 28705 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:19.582466 28705 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:19.583189 28705 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b055929893054954a1bb3629744d5b0f: Sending DeleteTablet for 3 replicas of tablet aaa30d9ba5ae422389af81264f3dec69
I20260811 10:06:19.583550 29123 tablet_service.cc:1514] Processing DeleteTablet for tablet aaa30d9ba5ae422389af81264f3dec69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:19 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:37280
I20260811 10:06:19.583541 28977 tablet_service.cc:1514] Processing DeleteTablet for tablet aaa30d9ba5ae422389af81264f3dec69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:19 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:50332
I20260811 10:06:19.583560 28836 tablet_service.cc:1514] Processing DeleteTablet for tablet aaa30d9ba5ae422389af81264f3dec69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:19 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:46204
I20260811 10:06:19.583796 29239 tablet_replica.cc:330] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: stopping tablet replica
I20260811 10:06:19.583892 29239 raft_consensus.cc:2229] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:06:19.583981 29239 raft_consensus.cc:2258] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:19.584117 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 28769
I20260811 10:06:19.584913 29239 ts_tablet_manager.cc:1905] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:19.587251 29239 ts_tablet_manager.cc:1918] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:19.587335 29239 log.cc:1196] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/aaa30d9ba5ae422389af81264f3dec69
I20260811 10:06:19.587657 29239 ts_tablet_manager.cc:1939] T aaa30d9ba5ae422389af81264f3dec69 P a812aec84fed44b19c38170c3b5c5ab2: Deleting consensus metadata
I20260811 10:06:19.589952 29240 tablet_replica.cc:330] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: stopping tablet replica
I20260811 10:06:19.590080 29240 raft_consensus.cc:2229] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:19.590178 29240 raft_consensus.cc:2258] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:19.590692 29240 ts_tablet_manager.cc:1905] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:19.591856 28689 catalog_manager.cc:4841] TS a812aec84fed44b19c38170c3b5c5ab2 (127.9.127.194:43847): tablet aaa30d9ba5ae422389af81264f3dec69 (table test-table [id=ece9a9bee2294b7080c2f42c16610af4]) successfully deleted
I20260811 10:06:19.592244 29240 ts_tablet_manager.cc:1918] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:19.592329 29240 log.cc:1196] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/aaa30d9ba5ae422389af81264f3dec69
I20260811 10:06:19.592579 29240 ts_tablet_manager.cc:1939] T aaa30d9ba5ae422389af81264f3dec69 P e85625c7ee8c45e7bc50eacfa755cd79: Deleting consensus metadata
I20260811 10:06:19.593029 28690 catalog_manager.cc:4841] TS e85625c7ee8c45e7bc50eacfa755cd79 (127.9.127.195:44039): tablet aaa30d9ba5ae422389af81264f3dec69 (table test-table [id=ece9a9bee2294b7080c2f42c16610af4]) successfully deleted
W20260811 10:06:19.595917 28690 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:34867 (error 108)
I20260811 10:06:19.596212 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 28911
I20260811 10:06:19.597137 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.596340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:34867 (local address 127.0.0.1:46210)
0811 10:06:19.597050 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.597098 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":686}
W20260811 10:06:19.599483 28690 catalog_manager.cc:4584] TS 945b6961a38245849b7661ba080dde67 (127.9.127.193:34867): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aaa30d9ba5ae422389af81264f3dec69: Network error: Client connection negotiation failed: client connection to 127.9.127.193:34867: connect: Connection refused (error 111)
I20260811 10:06:19.602120 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 29056
I20260811 10:06:19.607901 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 28672
2026-08-11T10:06:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1962 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T10:06:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:19Z Disabled control of system clock
I20260811 10:06:19.637131 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35859
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:34271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:35859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:19.716982 29245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:19.717200 29245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:19.717221 29245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:19.718317 29245 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:19.718350 29245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:19.718362 29245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:19.718375 29245 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:19.718386 29245 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:19.719655 29245 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:35859
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:19.719871 29245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:19.720105 29245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:19.724741 29251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.724752 29250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:19.724893 29245 server_base.cc:1034] running on GCE node
W20260811 10:06:19.724751 29253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:19.725227 29245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:19.725497 29245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:19.726660 29245 hybrid_clock.cc:648] HybridClock initialized: now 1786442779726665 us; error 46 us; skew 500 ppm
I20260811 10:06:19.727943 29245 webserver.cc:460] Webserver started at http://127.9.127.254:46461/ using document root <none> and password file <none>
I20260811 10:06:19.728204 29245 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:19.728276 29245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:19.728421 29245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:19.729490 29245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "0744be3d63fb4cdf830d90bb3edd8293"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "f544cb98bbcf512a2985b8f6f83aa4ac"
server_key_iv: "257eee967d453bdcac3fd2b49eb87e24"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.729833 29245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "0744be3d63fb4cdf830d90bb3edd8293"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "f544cb98bbcf512a2985b8f6f83aa4ac"
server_key_iv: "257eee967d453bdcac3fd2b49eb87e24"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.731027 29245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:19.731727 29260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.731887 29245 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:19.731993 29245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "0744be3d63fb4cdf830d90bb3edd8293"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "f544cb98bbcf512a2985b8f6f83aa4ac"
server_key_iv: "257eee967d453bdcac3fd2b49eb87e24"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.732067 29245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:19.743541 29245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:19.743806 29245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:19.743948 29245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:19.747915 29245 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:35859
I20260811 10:06:19.747946 29317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:35859 every 8 connection(s)
I20260811 10:06:19.748276 29245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:19.749308 29319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:19.751354 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 29245
I20260811 10:06:19.751471 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:19.751566 29319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293: Bootstrap starting.
I20260811 10:06:19.751703 9727 external_mini_cluster.cc:1428] Setting key df6ee1b291e57b0003af92dcd2108e86
I20260811 10:06:19.752345 29319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:19.752692 29319 log.cc:824] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:19.753443 29319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293: No bootstrap required, opened a new log
I20260811 10:06:19.755678 29319 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0744be3d63fb4cdf830d90bb3edd8293" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35859 } }
I20260811 10:06:19.755853 29319 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:19.755887 29319 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0744be3d63fb4cdf830d90bb3edd8293, State: Initialized, Role: FOLLOWER
I20260811 10:06:19.756007 29319 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0744be3d63fb4cdf830d90bb3edd8293" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35859 } }
I20260811 10:06:19.756076 29319 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:19.756105 29319 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:19.756156 29319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:19.756887 29319 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0744be3d63fb4cdf830d90bb3edd8293" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35859 } }
I20260811 10:06:19.757006 29319 leader_election.cc:302] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0744be3d63fb4cdf830d90bb3edd8293; no voters:
I20260811 10:06:19.757175 29319 leader_election.cc:288] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:19.757364 29326 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:19.757457 29319 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:19.757588 29326 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [term 1 LEADER]: Becoming Leader. State: Replica: 0744be3d63fb4cdf830d90bb3edd8293, State: Running, Role: LEADER
I20260811 10:06:19.757761 29326 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0744be3d63fb4cdf830d90bb3edd8293" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35859 } }
I20260811 10:06:19.758222 29326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0744be3d63fb4cdf830d90bb3edd8293" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0744be3d63fb4cdf830d90bb3edd8293" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35859 } } }
I20260811 10:06:19.758284 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.752206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51622 (local address 127.9.127.254:35859)
0811 10:06:19.752421 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.752429 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.752481 (+ 52us) server_negotiation.cc:407] Connection header received
0811 10:06:19.753056 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.753063 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.753151 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.753292 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:19.753458 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.754844 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.755573 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.756166 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.756624 (+ 458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.757305 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:19.757309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:19.757309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:19.757522 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:19.757564 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:19.757579 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:19.757919 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.757952 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.758039 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
I20260811 10:06:19.758587 29326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:19.758795 29326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0744be3d63fb4cdf830d90bb3edd8293. Latest consensus state: current_term: 1 leader_uuid: "0744be3d63fb4cdf830d90bb3edd8293" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0744be3d63fb4cdf830d90bb3edd8293" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35859 } } }
I20260811 10:06:19.759038 29326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293 [sys.catalog]: This master's current role is: LEADER
W20260811 10:06:19.759717 29341 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:19.759776 29341 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:19.759855 29340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:19.760030 29340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:19.761409 29340 catalog_manager.cc:1347] Generated new cluster ID: 066523272b8445e6bfc0c7be69a81036
I20260811 10:06:19.761458 29340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:19.778931 29340 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:19.779600 29340 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:19.791316 29340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293: Generated new TSK 0
I20260811 10:06:19.791497 29340 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:19.796546 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35859
--builtin_ntp_servers=127.9.127.212:34271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:19.889079 29345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:19.889297 29345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:19.889333 29345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:19.890443 29345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:19.890506 29345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:19.890550 29345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:06:19.891950 29345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:19.892213 29345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:19.892525 29345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:19.897396 29350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.897409 29351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:19.897398 29353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:19.897733 29345 server_base.cc:1034] running on GCE node
I20260811 10:06:19.897971 29345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:19.898217 29345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:19.899377 29345 hybrid_clock.cc:648] HybridClock initialized: now 1786442779899362 us; error 28 us; skew 500 ppm
I20260811 10:06:19.900596 29345 webserver.cc:460] Webserver started at http://127.9.127.193:43795/ using document root <none> and password file <none>
I20260811 10:06:19.900895 29345 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:19.900941 29345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:19.901088 29345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:19.902112 29345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "ba23694c389a4a34a51cf81e1ec86456"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "c28310cf4ffb6758d0b16ffd80387780"
server_key_iv: "c1d8990b9ac4127eca9c02a294f8c35b"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.902468 29345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "ba23694c389a4a34a51cf81e1ec86456"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "c28310cf4ffb6758d0b16ffd80387780"
server_key_iv: "c1d8990b9ac4127eca9c02a294f8c35b"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.903685 29345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:06:19.904353 29359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.904507 29345 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:19.904595 29345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "ba23694c389a4a34a51cf81e1ec86456"
format_stamp: "Formatted at 2026-08-11 10:06:19 on dist-test-slave-1x4g"
server_key: "c28310cf4ffb6758d0b16ffd80387780"
server_key_iv: "c1d8990b9ac4127eca9c02a294f8c35b"
server_key_version: "encryptionkey@0"
I20260811 10:06:19.904665 29345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:19.934680 29345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:19.934973 29345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:19.935114 29345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:19.935382 29345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:19.935766 29345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:19.935804 29345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.935827 29345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:19.935870 29345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:19.941730 29345 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:34765
I20260811 10:06:19.941787 29487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:34765 every 8 connection(s)
I20260811 10:06:19.942099 29345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:06:19.943130 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 29345
I20260811 10:06:19.943240 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:06:19.943468 9727 external_mini_cluster.cc:1428] Setting key e8a93ae565d14d72fa9b45d7aa125daa
I20260811 10:06:19.944577 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35859
--builtin_ntp_servers=127.9.127.212:34271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 10:06:19.948251 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.942784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:60579 (local address 127.9.127.254:35859)
0811 10:06:19.942826 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:19.942828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:19.943221 (+ 393us) server_negotiation.cc:407] Connection header received
0811 10:06:19.943892 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:19.943893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:19.943903 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:19.943938 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:19.944849 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.945318 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.946705 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.947023 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.947100 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.947953 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:19.947955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:19.947955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:19.947960 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:19.947978 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:19.947983 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:19.948038 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:19.948113 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 10:06:19.948140 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:06:19.948381 29491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:19.942781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35859 (local address 127.9.127.193:60579)
0811 10:06:19.943028 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:19.943077 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:19.943782 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:19.944017 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:19.944021 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:19.944031 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:19.944748 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.944756 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.945417 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.945418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.946591 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:19.946594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:19.947114 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:19.947115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:19.947228 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:19.947800 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:19.947801 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:19.947829 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:19.947864 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:19.948044 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:19.948049 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:19.948052 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:19.948101 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 10:06:19.948181 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":85,"threads_started":1}
I20260811 10:06:19.948895 29488 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35859
I20260811 10:06:19.949014 29488 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:19.949222 29488 heartbeater.cc:511] Master 127.9.127.254:35859 requested a full tablet report, sending...
I20260811 10:06:19.949823 29278 ts_manager.cc:194] Registered new tserver with Master: ba23694c389a4a34a51cf81e1ec86456 (127.9.127.193:34765)
I20260811 10:06:19.950762 29278 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.193:60579
W20260811 10:06:20.026613 29492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:20.026816 29492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:20.026836 29492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:20.027884 29492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:20.027915 29492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:20.027938 29492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:06:20.029171 29492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:20.029403 29492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:20.029657 29492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:20.034438 29497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:20.034489 29500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:20.034439 29498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:20.034693 29492 server_base.cc:1034] running on GCE node
I20260811 10:06:20.034893 29492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:20.035136 29492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:20.036270 29492 hybrid_clock.cc:648] HybridClock initialized: now 1786442780036253 us; error 33 us; skew 500 ppm
I20260811 10:06:20.037627 29492 webserver.cc:460] Webserver started at http://127.9.127.194:33343/ using document root <none> and password file <none>
I20260811 10:06:20.037892 29492 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:20.037938 29492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:20.038095 29492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:20.039083 29492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "bb36093780094f048e4abe76d527fc60"
format_stamp: "Formatted at 2026-08-11 10:06:20 on dist-test-slave-1x4g"
server_key: "56cf3ebc1fbaa1d098d0d5fa76dbd3c4"
server_key_iv: "b4b3adc574ea3171bd0ea7c8f44a25d1"
server_key_version: "encryptionkey@0"
I20260811 10:06:20.039413 29492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "bb36093780094f048e4abe76d527fc60"
format_stamp: "Formatted at 2026-08-11 10:06:20 on dist-test-slave-1x4g"
server_key: "56cf3ebc1fbaa1d098d0d5fa76dbd3c4"
server_key_iv: "b4b3adc574ea3171bd0ea7c8f44a25d1"
server_key_version: "encryptionkey@0"
I20260811 10:06:20.040660 29492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:06:20.041386 29507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:20.041541 29492 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:20.041644 29492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "bb36093780094f048e4abe76d527fc60"
format_stamp: "Formatted at 2026-08-11 10:06:20 on dist-test-slave-1x4g"
server_key: "56cf3ebc1fbaa1d098d0d5fa76dbd3c4"
server_key_iv: "b4b3adc574ea3171bd0ea7c8f44a25d1"
server_key_version: "encryptionkey@0"
I20260811 10:06:20.041716 29492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:20.065567 29492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:20.065894 29492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:20.066053 29492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:20.066293 29492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:20.066627 29492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:20.066680 29492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:20.066721 29492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:20.066749 29492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:20.072527 29492 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:39907
I20260811 10:06:20.072568 29627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:39907 every 8 connection(s)
I20260811 10:06:20.072979 29492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:06:20.078037 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.073788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:59791 (local address 127.9.127.254:35859)
0811 10:06:20.073874 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.073876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.074122 (+ 246us) server_negotiation.cc:407] Connection header received
0811 10:06:20.074605 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.074606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.074616 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.074671 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:20.075320 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.075800 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.076807 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.076988 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.077039 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.077807 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:20.077808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:20.077808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:20.077812 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:20.077826 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:20.077830 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:20.077873 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.077955 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.077975 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 10:06:20.078229 29630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.073739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35859 (local address 127.9.127.194:59791)
0811 10:06:20.073986 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:20.074027 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:20.074518 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:20.074733 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:20.074736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:20.074745 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:20.075252 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.075257 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.075881 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.075882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.076699 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.076701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.077064 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.077065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.077176 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.077673 (+ 497us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:20.077673 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:20.077703 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:20.077726 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:20.077885 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:20.077890 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:20.077892 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:06:20.077944 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 10:06:20.078024 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":139,"threads_started":1}
I20260811 10:06:20.078734 29628 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35859
I20260811 10:06:20.078827 29628 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:20.078994 29628 heartbeater.cc:511] Master 127.9.127.254:35859 requested a full tablet report, sending...
I20260811 10:06:20.079363 29278 ts_manager.cc:194] Registered new tserver with Master: bb36093780094f048e4abe76d527fc60 (127.9.127.194:39907)
I20260811 10:06:20.079779 29278 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.194:59791
I20260811 10:06:20.081187 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 29492
I20260811 10:06:20.081295 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:06:20.081502 9727 external_mini_cluster.cc:1428] Setting key 7ce5149635908bfab2faffd05cf1f9ee
I20260811 10:06:20.082405 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35859
--builtin_ntp_servers=127.9.127.212:34271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:20.164077 29631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:20.164297 29631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:20.164333 29631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:20.165501 29631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:20.165563 29631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:20.165614 29631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:06:20.166960 29631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:34271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:35859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:20.167222 29631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:20.167506 29631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:20.172324 29641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:20.172358 29639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:20.172356 29638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:20.172544 29631 server_base.cc:1034] running on GCE node
I20260811 10:06:20.172886 29631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:20.173135 29631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:20.174301 29631 hybrid_clock.cc:648] HybridClock initialized: now 1786442780174283 us; error 31 us; skew 500 ppm
I20260811 10:06:20.175513 29631 webserver.cc:460] Webserver started at http://127.9.127.195:46235/ using document root <none> and password file <none>
I20260811 10:06:20.175753 29631 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:20.175820 29631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:20.175954 29631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:20.177093 29631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "8055c36ed8224974a85593a62f2c5a5f"
format_stamp: "Formatted at 2026-08-11 10:06:20 on dist-test-slave-1x4g"
server_key: "e178d1ef5f1fbc36fa50c582eb4cfaa8"
server_key_iv: "7697d090cb3fd5489c6adaea2fe8964a"
server_key_version: "encryptionkey@0"
I20260811 10:06:20.177464 29631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "8055c36ed8224974a85593a62f2c5a5f"
format_stamp: "Formatted at 2026-08-11 10:06:20 on dist-test-slave-1x4g"
server_key: "e178d1ef5f1fbc36fa50c582eb4cfaa8"
server_key_iv: "7697d090cb3fd5489c6adaea2fe8964a"
server_key_version: "encryptionkey@0"
I20260811 10:06:20.178742 29631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:20.179421 29647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:20.179600 29631 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:20.179706 29631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "8055c36ed8224974a85593a62f2c5a5f"
format_stamp: "Formatted at 2026-08-11 10:06:20 on dist-test-slave-1x4g"
server_key: "e178d1ef5f1fbc36fa50c582eb4cfaa8"
server_key_iv: "7697d090cb3fd5489c6adaea2fe8964a"
server_key_version: "encryptionkey@0"
I20260811 10:06:20.179780 29631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:20.196106 29631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:20.196426 29631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:20.196584 29631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:20.196915 29631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:20.197273 29631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:20.197329 29631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:20.197374 29631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:20.197397 29631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:20.203034 29631 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:43405
I20260811 10:06:20.203109 29765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:43405 every 8 connection(s)
I20260811 10:06:20.203461 29631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:06:20.207914 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 29631
I20260811 10:06:20.208025 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:06:20.208276 9727 external_mini_cluster.cc:1428] Setting key cb52fbc57535961cd07aefa8c166d082
I20260811 10:06:20.208868 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.204256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:34407 (local address 127.9.127.254:35859)
0811 10:06:20.204327 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.204328 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.204529 (+ 201us) server_negotiation.cc:407] Connection header received
0811 10:06:20.205064 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.205065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.205081 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.205158 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:20.205818 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.206303 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.207258 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.207486 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.207543 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.208552 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:20.208554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:20.208554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:20.208558 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:20.208572 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:20.208576 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:20.208643 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.208743 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.208771 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 10:06:20.209092 29768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.204215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:35859 (local address 127.9.127.195:34407)
0811 10:06:20.204401 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:20.204439 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:20.204978 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:20.205226 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:20.205229 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:20.205238 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:20.205747 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.205751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.206383 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.206384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.207186 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.207187 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.207555 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.207556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.207665 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.208295 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:20.208296 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:20.208336 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:20.208364 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:20.208646 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:20.208654 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:20.208658 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:20.208745 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 10:06:20.208877 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260811 10:06:20.209600 29766 heartbeater.cc:347] Connected to a master server at 127.9.127.254:35859
I20260811 10:06:20.209685 29766 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:20.209888 29766 heartbeater.cc:511] Master 127.9.127.254:35859 requested a full tablet report, sending...
I20260811 10:06:20.210255 29278 ts_manager.cc:194] Registered new tserver with Master: 8055c36ed8224974a85593a62f2c5a5f (127.9.127.195:43405)
I20260811 10:06:20.210632 29278 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.195:34407
I20260811 10:06:20.220475 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:06:20.225095 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.222013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51636 (local address 127.9.127.254:35859)
0811 10:06:20.222101 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.222104 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.222203 (+ 99us) server_negotiation.cc:407] Connection header received
0811 10:06:20.222280 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.222281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.222293 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.222366 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:20.222554 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.223059 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.223839 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.224045 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.224123 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.224801 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:20.224802 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:20.224803 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:20.224807 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:20.224822 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:20.224826 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:20.224897 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.224984 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.225006 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 10:06:20.226816 29278 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51636:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:06:20.228437 29278 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:06:20.235046 29776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.230705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43405 (local address 127.0.0.1:52710)
0811 10:06:20.231024 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:20.231063 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:20.231130 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:20.231526 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:20.231527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:20.231529 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:20.231618 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.231620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.233010 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.233011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.234065 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.234066 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.234730 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.234731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.234811 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.234824 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 10:06:20.234915 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 10:06:20.234974 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":2,"thread_start_us":88,"threads_started":1}
I20260811 10:06:20.235078 29777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.230799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52710 (local address 127.9.127.195:43405)
0811 10:06:20.231361 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.231365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.231375 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:20.231410 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.231412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.231428 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.231711 (+ 283us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:20.231780 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.232912 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.234161 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.234640 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.234728 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.234819 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.234937 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.234996 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":109,"threads_started":1}
I20260811 10:06:20.235965 29779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.230705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39907 (local address 127.0.0.1:59744)
0811 10:06:20.231218 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:20.231230 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:20.231285 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:20.231665 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:20.231665 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:20.231667 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:20.231706 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.231707 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.234159 (+ 2452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.234160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.234906 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.234909 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.235715 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.235716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.235773 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.235776 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:20.235834 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 10:06:20.235872 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":2,"thread_start_us":60,"threads_started":1}
I20260811 10:06:20.235977 29778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.230839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59744 (local address 127.9.127.194:39907)
0811 10:06:20.231260 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.231265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.231276 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:06:20.231386 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.231388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.231404 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.231647 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:20.231786 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.232925 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.235001 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.235626 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.235715 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.235798 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.235849 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.235901 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":73,"threads_started":1}
I20260811 10:06:20.235843 29697 tablet_service.cc:1467] Processing CreateTablet for tablet 957060520b554b3ca5bc9d038ff6d454 (DEFAULT_TABLE table=test-table [id=86ddb32f10104350a26aeb3496e95a2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:20.236277 29697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 957060520b554b3ca5bc9d038ff6d454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:20.236512 29774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.230919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:34765 (local address 127.0.0.1:46328)
0811 10:06:20.231257 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:20.231266 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:20.231313 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:20.231516 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:20.231519 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:20.231521 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:20.231875 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.231877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.232727 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.232728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.234057 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.234060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.236287 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.236288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.236353 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.236358 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:06:20.236408 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 10:06:20.236450 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":281,"thread_start_us":64,"threads_started":1}
I20260811 10:06:20.236632 29558 tablet_service.cc:1467] Processing CreateTablet for tablet 957060520b554b3ca5bc9d038ff6d454 (DEFAULT_TABLE table=test-table [id=86ddb32f10104350a26aeb3496e95a2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:20.236881 29780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.231039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46328 (local address 127.9.127.193:34765)
0811 10:06:20.231242 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.231247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.231304 (+ 57us) server_negotiation.cc:407] Connection header received
0811 10:06:20.231388 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.231390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.231411 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.231500 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:20.231933 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.232617 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.234859 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.235914 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.235996 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.236696 (+ 700us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.236724 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.236765 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":95,"threads_started":1}
I20260811 10:06:20.237032 29558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 957060520b554b3ca5bc9d038ff6d454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:20.239106 29781 tablet_bootstrap.cc:492] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: Bootstrap starting.
I20260811 10:06:20.239686 29782 tablet_bootstrap.cc:492] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: Bootstrap starting.
I20260811 10:06:20.239959 29781 tablet_bootstrap.cc:654] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:20.239993 29412 tablet_service.cc:1467] Processing CreateTablet for tablet 957060520b554b3ca5bc9d038ff6d454 (DEFAULT_TABLE table=test-table [id=86ddb32f10104350a26aeb3496e95a2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:20.240310 29781 log.cc:824] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:20.240319 29412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 957060520b554b3ca5bc9d038ff6d454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:20.240319 29782 tablet_bootstrap.cc:654] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:20.240659 29782 log.cc:824] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:20.241124 29781 tablet_bootstrap.cc:492] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: No bootstrap required, opened a new log
I20260811 10:06:20.241194 29781 ts_tablet_manager.cc:1397] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:06:20.241441 29782 tablet_bootstrap.cc:492] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: No bootstrap required, opened a new log
I20260811 10:06:20.241528 29782 ts_tablet_manager.cc:1397] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:06:20.243187 29781 raft_consensus.cc:348] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.243335 29781 raft_consensus.cc:374] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:20.243377 29781 raft_consensus.cc:729] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8055c36ed8224974a85593a62f2c5a5f, State: Initialized, Role: FOLLOWER
I20260811 10:06:20.243494 29781 consensus_queue.cc:260] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.243795 29781 ts_tablet_manager.cc:1428] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 10:06:20.243935 29766 heartbeater.cc:503] Master 127.9.127.254:35859 was elected leader, sending a full tablet report...
I20260811 10:06:20.244123 29782 raft_consensus.cc:348] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.244305 29782 raft_consensus.cc:374] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:20.244354 29782 raft_consensus.cc:729] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb36093780094f048e4abe76d527fc60, State: Initialized, Role: FOLLOWER
I20260811 10:06:20.244459 29782 consensus_queue.cc:260] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.244716 29782 ts_tablet_manager.cc:1428] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:06:20.244760 29628 heartbeater.cc:503] Master 127.9.127.254:35859 was elected leader, sending a full tablet report...
I20260811 10:06:20.244927 29786 tablet_bootstrap.cc:492] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456: Bootstrap starting.
I20260811 10:06:20.245559 29786 tablet_bootstrap.cc:654] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:20.245863 29786 log.cc:824] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:20.246506 29786 tablet_bootstrap.cc:492] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456: No bootstrap required, opened a new log
I20260811 10:06:20.246557 29786 ts_tablet_manager.cc:1397] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:06:20.248281 29786 raft_consensus.cc:348] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.248396 29786 raft_consensus.cc:374] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:20.248441 29786 raft_consensus.cc:729] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba23694c389a4a34a51cf81e1ec86456, State: Initialized, Role: FOLLOWER
I20260811 10:06:20.248559 29786 consensus_queue.cc:260] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.248852 29786 ts_tablet_manager.cc:1428] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:06:20.248880 29488 heartbeater.cc:503] Master 127.9.127.254:35859 was elected leader, sending a full tablet report...
I20260811 10:06:20.265954 29789 raft_consensus.cc:482] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:20.266048 29789 raft_consensus.cc:504] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.266439 29789 leader_election.cc:288] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8055c36ed8224974a85593a62f2c5a5f (127.9.127.195:43405), ba23694c389a4a34a51cf81e1ec86456 (127.9.127.193:34765)
I20260811 10:06:20.270284 29780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.266832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:33645 (local address 127.9.127.193:34765)
0811 10:06:20.266873 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.266875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.266936 (+ 61us) server_negotiation.cc:407] Connection header received
0811 10:06:20.266983 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.266985 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.267001 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.267070 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:20.267210 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.267895 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.269371 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.269908 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.269985 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.269993 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.270181 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.270219 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:06:20.270284 29777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.266704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:35085 (local address 127.9.127.195:43405)
0811 10:06:20.266771 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.266773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.266783 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:20.266815 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.266816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.266825 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.266881 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:20.267066 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.267851 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.269371 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.269908 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.269989 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.269995 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.270181 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.270219 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:06:20.270303 29630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.266620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43405 (local address 127.9.127.194:35085)
0811 10:06:20.266684 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:20.266696 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:20.266738 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:20.266910 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:20.266911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:20.266913 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:20.266993 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.266995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.267955 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.267973 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.269279 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.269283 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.269996 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.269996 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.270100 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.270106 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 10:06:20.270162 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 10:06:20.270212 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":117}
I20260811 10:06:20.270309 29792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.266744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:34765 (local address 127.9.127.194:33645)
0811 10:06:20.266875 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:20.266883 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:20.266931 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:20.267092 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:20.267093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:20.267094 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:20.267146 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.267147 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.267961 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.267962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.269284 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:20.269286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.269997 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.269997 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:20.270100 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.270107 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 10:06:20.270162 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 10:06:20.270212 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":51,"thread_start_us":90,"threads_started":1}
I20260811 10:06:20.270650 29718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "957060520b554b3ca5bc9d038ff6d454" candidate_uuid: "bb36093780094f048e4abe76d527fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8055c36ed8224974a85593a62f2c5a5f" is_pre_election: true
I20260811 10:06:20.270756 29435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "957060520b554b3ca5bc9d038ff6d454" candidate_uuid: "bb36093780094f048e4abe76d527fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba23694c389a4a34a51cf81e1ec86456" is_pre_election: true
I20260811 10:06:20.270812 29718 raft_consensus.cc:2454] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb36093780094f048e4abe76d527fc60 in term 0.
I20260811 10:06:20.270927 29435 raft_consensus.cc:2454] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb36093780094f048e4abe76d527fc60 in term 0.
I20260811 10:06:20.271056 29509 leader_election.cc:302] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8055c36ed8224974a85593a62f2c5a5f, bb36093780094f048e4abe76d527fc60; no voters:
I20260811 10:06:20.271193 29789 raft_consensus.cc:2781] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:06:20.271270 29789 raft_consensus.cc:482] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:06:20.271303 29789 raft_consensus.cc:3037] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:20.272001 29789 raft_consensus.cc:504] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.272137 29789 leader_election.cc:288] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [CANDIDATE]: Term 1 election: Requested vote from peers 8055c36ed8224974a85593a62f2c5a5f (127.9.127.195:43405), ba23694c389a4a34a51cf81e1ec86456 (127.9.127.193:34765)
I20260811 10:06:20.272295 29718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "957060520b554b3ca5bc9d038ff6d454" candidate_uuid: "bb36093780094f048e4abe76d527fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8055c36ed8224974a85593a62f2c5a5f"
I20260811 10:06:20.272300 29435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "957060520b554b3ca5bc9d038ff6d454" candidate_uuid: "bb36093780094f048e4abe76d527fc60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba23694c389a4a34a51cf81e1ec86456"
I20260811 10:06:20.272363 29718 raft_consensus.cc:3037] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:20.272387 29435 raft_consensus.cc:3037] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:20.273144 29435 raft_consensus.cc:2454] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb36093780094f048e4abe76d527fc60 in term 1.
I20260811 10:06:20.273154 29718 raft_consensus.cc:2454] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb36093780094f048e4abe76d527fc60 in term 1.
I20260811 10:06:20.273334 29509 leader_election.cc:302] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba23694c389a4a34a51cf81e1ec86456, bb36093780094f048e4abe76d527fc60; no voters:
I20260811 10:06:20.273439 29789 raft_consensus.cc:2781] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:20.273590 29789 raft_consensus.cc:686] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 1 LEADER]: Becoming Leader. State: Replica: bb36093780094f048e4abe76d527fc60, State: Running, Role: LEADER
I20260811 10:06:20.273690 29789 consensus_queue.cc:237] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } }
I20260811 10:06:20.274493 29277 catalog_manager.cc:5495] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb36093780094f048e4abe76d527fc60 (127.9.127.194). New cstate: current_term: 1 leader_uuid: "bb36093780094f048e4abe76d527fc60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb36093780094f048e4abe76d527fc60" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39907 } health_report { overall_health: HEALTHY } } }
I20260811 10:06:20.282632 29778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.280542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59746 (local address 127.9.127.194:39907)
0811 10:06:20.280605 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:20.280607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:20.280629 (+ 22us) server_negotiation.cc:407] Connection header received
0811 10:06:20.280656 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:20.280657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:20.280672 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:20.280724 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:20.280867 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.281321 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.281986 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:20.282153 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:20.282199 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:20.282366 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:20.282451 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:20.282513 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:20.282556 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 10:06:20.282572 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 10:06:20.284287 29718 raft_consensus.cc:1261] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 1 FOLLOWER]: Refusing update from remote peer bb36093780094f048e4abe76d527fc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:20.284287 29435 raft_consensus.cc:1261] T 957060520b554b3ca5bc9d038ff6d454 P ba23694c389a4a34a51cf81e1ec86456 [term 1 FOLLOWER]: Refusing update from remote peer bb36093780094f048e4abe76d527fc60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:20.284662 29793 consensus_queue.cc:1035] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba23694c389a4a34a51cf81e1ec86456" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:20.284806 29789 consensus_queue.cc:1035] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8055c36ed8224974a85593a62f2c5a5f" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:20.287187 29796 mvcc.cc:205] Tried to move back new op lower bound from 7317269628041949184 to 7317269628001738752. Current Snapshot: MvccSnapshot[applied={T|T < 7317269628041949184}]
I20260811 10:06:20.287358 29799 mvcc.cc:205] Tried to move back new op lower bound from 7317269628041949184 to 7317269628001738752. Current Snapshot: MvccSnapshot[applied={T|T < 7317269628041949184}]
I20260811 10:06:20.287592 29797 mvcc.cc:205] Tried to move back new op lower bound from 7317269628041949184 to 7317269628001738752. Current Snapshot: MvccSnapshot[applied={T|T < 7317269628041949184}]
I20260811 10:06:20.289374 29277 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:20.289469 29277 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:20.290228 29277 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0744be3d63fb4cdf830d90bb3edd8293: Sending DeleteTablet for 3 replicas of tablet 957060520b554b3ca5bc9d038ff6d454
I20260811 10:06:20.290558 29558 tablet_service.cc:1514] Processing DeleteTablet for tablet 957060520b554b3ca5bc9d038ff6d454 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:20 UTC) from {username='slave'} at 127.0.0.1:59744
I20260811 10:06:20.290654 29412 tablet_service.cc:1514] Processing DeleteTablet for tablet 957060520b554b3ca5bc9d038ff6d454 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:20 UTC) from {username='slave'} at 127.0.0.1:46328
I20260811 10:06:20.290668 29697 tablet_service.cc:1514] Processing DeleteTablet for tablet 957060520b554b3ca5bc9d038ff6d454 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:20 UTC) from {username='slave'} at 127.0.0.1:52710
I20260811 10:06:20.290782 29807 tablet_replica.cc:330] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: stopping tablet replica
I20260811 10:06:20.290884 29807 raft_consensus.cc:2229] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:06:20.291000 29807 raft_consensus.cc:2258] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:20.291057 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 29345
I20260811 10:06:20.298225 29807 ts_tablet_manager.cc:1905] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:20.299790 29807 ts_tablet_manager.cc:1918] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:20.299896 29807 log.cc:1196] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/957060520b554b3ca5bc9d038ff6d454
I20260811 10:06:20.300089 29809 tablet_replica.cc:330] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: stopping tablet replica
I20260811 10:06:20.300209 29807 ts_tablet_manager.cc:1939] T 957060520b554b3ca5bc9d038ff6d454 P bb36093780094f048e4abe76d527fc60: Deleting consensus metadata
I20260811 10:06:20.300297 29809 raft_consensus.cc:2229] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:20.300452 29809 raft_consensus.cc:2258] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:20.300617 29264 catalog_manager.cc:4841] TS bb36093780094f048e4abe76d527fc60 (127.9.127.194:39907): tablet 957060520b554b3ca5bc9d038ff6d454 (table test-table [id=86ddb32f10104350a26aeb3496e95a2c]) successfully deleted
I20260811 10:06:20.301007 29809 ts_tablet_manager.cc:1905] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:20.302239 29809 ts_tablet_manager.cc:1918] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:20.302327 29809 log.cc:1196] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/957060520b554b3ca5bc9d038ff6d454
I20260811 10:06:20.302547 29809 ts_tablet_manager.cc:1939] T 957060520b554b3ca5bc9d038ff6d454 P 8055c36ed8224974a85593a62f2c5a5f: Deleting consensus metadata
W20260811 10:06:20.302914 29262 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:34765 (error 108)
I20260811 10:06:20.303141 29262 catalog_manager.cc:4841] TS 8055c36ed8224974a85593a62f2c5a5f (127.9.127.195:43405): tablet 957060520b554b3ca5bc9d038ff6d454 (table test-table [id=86ddb32f10104350a26aeb3496e95a2c]) successfully deleted
I20260811 10:06:20.303203 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 29492
I20260811 10:06:20.304107 29774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:20.303288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:34765 (local address 127.0.0.1:46340)
0811 10:06:20.304025 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:20.304070 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:34765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":714}
W20260811 10:06:20.305364 29262 catalog_manager.cc:4584] TS ba23694c389a4a34a51cf81e1ec86456 (127.9.127.193:34765): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 957060520b554b3ca5bc9d038ff6d454: Network error: Client connection negotiation failed: client connection to 127.9.127.193:34765: connect: Connection refused (error 111)
I20260811 10:06:20.319312 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 29631
I20260811 10:06:20.325403 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 29245
2026-08-11T10:06:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (716 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:20 dist-test-slave-1x4g krb5kdc[29814](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:20 dist-test-slave-1x4g krb5kdc[29814](info): set up 2 sockets
Aug 11 10:06:20 dist-test-slave-1x4g krb5kdc[29814](info): commencing operation
krb5kdc: starting...
W20260811 10:06:21.406162 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:21 dist-test-slave-1x4g krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442781, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:21.527352 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:38929
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:38929
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:21.608156 29829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:21.608347 29829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:21.608369 29829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:21.609418 29829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:21.609454 29829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:21.609467 29829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:21.609480 29829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:21.609491 29829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:21.610891 29829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:38929
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:38929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:21.611079 29829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:21.611243 29829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:21.616176 29834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:21.616187 29835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:21.616187 29837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:21.616434 29829 server_base.cc:1034] running on GCE node
I20260811 10:06:21.616673 29829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:21.617005 29829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:21.618281 29829 hybrid_clock.cc:648] HybridClock initialized: now 1786442781618275 us; error 43 us; skew 500 ppm
Aug 11 10:06:21 dist-test-slave-1x4g krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442781, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:21.620985 29829 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:21.621438 29829 webserver.cc:460] Webserver started at http://127.9.127.254:40791/ using document root <none> and password file <none>
I20260811 10:06:21.621692 29829 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:21.621757 29829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:21.621905 29829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:21.622970 29829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "d03b871a2d294adfbd55af72510ee622"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "69b114328fbd5c1ad852eda3d859a88e"
server_key_iv: "6fe90e6b9e4cec3252baed976ec34f3d"
server_key_version: "encryptionkey@0"
I20260811 10:06:21.623329 29829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "d03b871a2d294adfbd55af72510ee622"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "69b114328fbd5c1ad852eda3d859a88e"
server_key_iv: "6fe90e6b9e4cec3252baed976ec34f3d"
server_key_version: "encryptionkey@0"
I20260811 10:06:21.624657 29829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:21.625393 29845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:21.625566 29829 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:21.625695 29829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "d03b871a2d294adfbd55af72510ee622"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "69b114328fbd5c1ad852eda3d859a88e"
server_key_iv: "6fe90e6b9e4cec3252baed976ec34f3d"
server_key_version: "encryptionkey@0"
I20260811 10:06:21.625771 29829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:21.634936 29829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:21.637243 29829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:21.637404 29829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:21.641587 29829 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:38929
I20260811 10:06:21.641626 29900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:38929 every 8 connection(s)
I20260811 10:06:21.641968 29829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:21.642812 29901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:21.645078 29901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622: Bootstrap starting.
I20260811 10:06:21.645596 29901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:21.645835 29901 log.cc:824] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:21.646498 29901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622: No bootstrap required, opened a new log
I20260811 10:06:21.648067 29901 raft_consensus.cc:348] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03b871a2d294adfbd55af72510ee622" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38929 } }
I20260811 10:06:21.648196 29901 raft_consensus.cc:374] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:21.648218 29901 raft_consensus.cc:729] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d03b871a2d294adfbd55af72510ee622, State: Initialized, Role: FOLLOWER
I20260811 10:06:21.648348 29901 consensus_queue.cc:260] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03b871a2d294adfbd55af72510ee622" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38929 } }
I20260811 10:06:21.648432 29901 raft_consensus.cc:388] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:21.648456 29901 raft_consensus.cc:482] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:21.648484 29901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:21.649076 29901 raft_consensus.cc:504] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03b871a2d294adfbd55af72510ee622" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38929 } }
I20260811 10:06:21.649163 29901 leader_election.cc:302] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d03b871a2d294adfbd55af72510ee622; no voters:
I20260811 10:06:21.649278 29901 leader_election.cc:288] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:21.649340 29905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:21.649528 29901 sys_catalog.cc:564] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:21.649514 29905 raft_consensus.cc:686] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [term 1 LEADER]: Becoming Leader. State: Replica: d03b871a2d294adfbd55af72510ee622, State: Running, Role: LEADER
I20260811 10:06:21.649664 29905 consensus_queue.cc:237] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03b871a2d294adfbd55af72510ee622" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38929 } }
I20260811 10:06:21.650079 29907 sys_catalog.cc:455] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d03b871a2d294adfbd55af72510ee622. Latest consensus state: current_term: 1 leader_uuid: "d03b871a2d294adfbd55af72510ee622" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03b871a2d294adfbd55af72510ee622" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38929 } } }
I20260811 10:06:21.650189 29907 sys_catalog.cc:458] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:21.650174 29906 sys_catalog.cc:455] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d03b871a2d294adfbd55af72510ee622" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d03b871a2d294adfbd55af72510ee622" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38929 } } }
I20260811 10:06:21.650264 29906 sys_catalog.cc:458] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:21.650538 29915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:21.651101 29915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:21.652155 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 29829
I20260811 10:06:21.652281 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:21.652494 9727 external_mini_cluster.cc:1428] Setting key 439b3e18a5977630f278c789f27382a4
I20260811 10:06:21.653107 29915 catalog_manager.cc:1347] Generated new cluster ID: f219f40db3674c38931877fda22a4b40
I20260811 10:06:21.653157 29915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:06:21 dist-test-slave-1x4g krb5kdc[29814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442781, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:21.670214 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:21.652962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50380 (local address 127.9.127.254:38929)
0811 10:06:21.660978 (+ 8016us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:21.660988 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:21.661194 (+ 206us) server_negotiation.cc:407] Connection header received
0811 10:06:21.661367 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:21.661374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:21.661418 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:21.661556 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:21.662227 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:21.663156 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:21.663923 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:21.664352 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:21.664472 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:21.666866 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:21.666870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:21.666870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:21.666882 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:21.668583 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:21.669021 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:21.669024 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:21.669025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:21.669124 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:21.669339 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:21.669340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:21.669340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:21.669599 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:21.669753 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:21.669875 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 10:06:21.670019 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7954,"thread_start_us":86,"threads_started":1}
I20260811 10:06:21.677636 29915 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:21.678133 29915 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:21.681674 29915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622: Generated new TSK 0
I20260811 10:06:21.681850 29915 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:06:21.712392 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38929
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:21.829660 29930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:21.829944 29930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:21.829983 29930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:21.831475 29930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:21.831532 29930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:21.831568 29930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:06:21.833491 29930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:21.833745 29930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:21.833992 29930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:21.839042 29938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:21.839051 29937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:21.839071 29941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:21.839265 29930 server_base.cc:1034] running on GCE node
I20260811 10:06:21.839452 29930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:21.839689 29930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:21.840842 29930 hybrid_clock.cc:648] HybridClock initialized: now 1786442781840830 us; error 35 us; skew 500 ppm
Aug 11 10:06:21 dist-test-slave-1x4g krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442781, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:21.843374 29930 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:06:21.843748 29930 webserver.cc:460] Webserver started at http://127.9.127.193:45661/ using document root <none> and password file <none>
I20260811 10:06:21.843921 29930 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:21.843961 29930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:21.844048 29930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:21.845125 29930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "640b057f636f4d679d17aca001441cdf"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "fd0975da64f3313b46b75cc22536612a"
server_key_iv: "f71ec1d8895003905528cbe568048a4f"
server_key_version: "encryptionkey@0"
I20260811 10:06:21.845423 29930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "640b057f636f4d679d17aca001441cdf"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "fd0975da64f3313b46b75cc22536612a"
server_key_iv: "f71ec1d8895003905528cbe568048a4f"
server_key_version: "encryptionkey@0"
I20260811 10:06:21.846664 29930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:06:21.847363 29948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:21.847559 29930 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:21.847661 29930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "640b057f636f4d679d17aca001441cdf"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "fd0975da64f3313b46b75cc22536612a"
server_key_iv: "f71ec1d8895003905528cbe568048a4f"
server_key_version: "encryptionkey@0"
I20260811 10:06:21.847733 29930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:21.867748 29930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:21.869976 29930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:21.870095 29930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:21.870256 29930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:21.870563 29930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:21.870605 29930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:21.870625 29930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:21.870675 29930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:21.876528 29930 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:35087
I20260811 10:06:21.876581 30070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:35087 every 8 connection(s)
I20260811 10:06:21.876906 29930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:06:21.878408 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 29930
I20260811 10:06:21.878521 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:06:21.878744 9727 external_mini_cluster.cc:1428] Setting key d7235ff04ed91b116c9d76e80f1c4b00
Aug 11 10:06:21 dist-test-slave-1x4g krb5kdc[29814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442781, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:21.886518 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:21.877660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:40081 (local address 127.9.127.254:38929)
0811 10:06:21.877749 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:21.877752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:21.877972 (+ 220us) server_negotiation.cc:407] Connection header received
0811 10:06:21.878563 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:21.878564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:21.878581 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:21.878630 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:21.879724 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:21.880221 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:21.881255 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:21.881466 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:21.881542 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:21.883763 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:21.883765 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:21.883765 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:21.883772 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:21.885158 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:21.885539 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:21.885540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:21.885540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:21.885618 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:21.885875 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:21.885876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:21.885876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:21.885995 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:21.886066 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:21.886333 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 10:06:21.886435 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 10:06:21.886703 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:21.877626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38929 (local address 127.9.127.193:40081)
0811 10:06:21.877831 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:21.877887 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:21.878444 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:21.878699 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:21.878702 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:21.879365 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:21.879628 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:21.879634 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:21.880318 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:21.880320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:21.881166 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:21.881169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:21.881552 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:21.881553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:21.881675 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:21.882128 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:21.882135 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:21.883665 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:21.885248 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:21.885255 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:21.885257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:21.885462 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:21.885685 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:21.885686 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:21.885686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:21.885808 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:21.886072 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:21.886079 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:21.886214 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 10:06:21.886311 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 10:06:21.886472 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":84,"threads_started":1}
I20260811 10:06:21.887311 30071 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38929
I20260811 10:06:21.887401 30071 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:21.887591 30071 heartbeater.cc:511] Master 127.9.127.254:38929 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
I20260811 10:06:21.888175 29862 ts_manager.cc:194] Registered new tserver with Master: 640b057f636f4d679d17aca001441cdf (127.9.127.193:35087)
I20260811 10:06:21.888831 29862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:40081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:06:21.905460 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38929
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:21.986596 30076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:21.986785 30076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:21.986809 30076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:21.987861 30076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:21.987896 30076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:21.987922 30076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:06:21.989429 30076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:21.989636 30076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:21.989795 30076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:21.994448 30082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:21.994520 30085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:21.994556 30076 server_base.cc:1034] running on GCE node
W20260811 10:06:21.994520 30083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:21.994824 30076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:21.995088 30076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:21.996265 30076 hybrid_clock.cc:648] HybridClock initialized: now 1786442781996313 us; error 88 us; skew 500 ppm
Aug 11 10:06:21 dist-test-slave-1x4g krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442781, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:21.998914 30076 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:06:21.999366 30076 webserver.cc:460] Webserver started at http://127.9.127.194:37807/ using document root <none> and password file <none>
I20260811 10:06:21.999610 30076 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:21.999656 30076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:21.999747 30076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:22.000698 30076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "343f96f55dcc4e628bc91d7faf98a917"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "e1c4c24d187234bdcf0b1e2848de9b71"
server_key_iv: "bfbb5366e4722a416c2ee3fc176e76fd"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.001065 30076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "343f96f55dcc4e628bc91d7faf98a917"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "e1c4c24d187234bdcf0b1e2848de9b71"
server_key_iv: "bfbb5366e4722a416c2ee3fc176e76fd"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.002339 30076 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:22.003017 30093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.003183 30076 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.003257 30076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "343f96f55dcc4e628bc91d7faf98a917"
format_stamp: "Formatted at 2026-08-11 10:06:21 on dist-test-slave-1x4g"
server_key: "e1c4c24d187234bdcf0b1e2848de9b71"
server_key_iv: "bfbb5366e4722a416c2ee3fc176e76fd"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.003309 30076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:22.013666 30076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:22.015251 30076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:22.015352 30076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:22.015527 30076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:22.015753 30076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:22.015781 30076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.015800 30076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:22.015812 30076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.021603 30076 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:41135
I20260811 10:06:22.021680 30217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:41135 every 8 connection(s)
I20260811 10:06:22.021957 30076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
Aug 11 10:06:22 dist-test-slave-1x4g krb5kdc[29814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442781, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:22.030042 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 30076
I20260811 10:06:22.030172 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:06:22.030413 9727 external_mini_cluster.cc:1428] Setting key cbeee86732581e97e521340262f4b15b
I20260811 10:06:22.031538 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.022603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38929 (local address 127.9.127.194:34457)
0811 10:06:22.022788 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.022828 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.023322 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.023563 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.023567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.024125 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:22.024301 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.024305 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.025068 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.025069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.025838 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.025840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.026243 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.026244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.026360 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.026884 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:22.026892 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:22.028251 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:22.030151 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:22.030158 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:22.030160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:22.030410 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:22.030646 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:22.030647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:22.030647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:22.030784 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:22.031038 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:22.031045 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:22.031180 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.031261 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.031377 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
I20260811 10:06:22.031541 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.022647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:34457 (local address 127.9.127.254:38929)
0811 10:06:22.022731 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.022733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.022911 (+ 178us) server_negotiation.cc:407] Connection header received
0811 10:06:22.023432 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.023434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.023448 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.023499 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:22.024399 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.024974 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.025943 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.026149 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.026219 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.028333 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:22.028334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:22.028334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:22.028340 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:22.030024 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:22.030489 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:22.030491 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:22.030491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:22.030559 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:22.030828 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:22.030828 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:22.030829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:22.030955 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:22.031026 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.031293 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.031396 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 10:06:22.032212 30218 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38929
I20260811 10:06:22.032297 30218 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:22.032497 30218 heartbeater.cc:511] Master 127.9.127.254:38929 requested a full tablet report, sending...
I20260811 10:06:22.032883 29862 ts_manager.cc:194] Registered new tserver with Master: 343f96f55dcc4e628bc91d7faf98a917 (127.9.127.194:41135)
I20260811 10:06:22.033241 29862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:34457
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:06:22.056035 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38929
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:22.135689 30223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:22.135917 30223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:22.135953 30223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:22.137161 30223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:22.137229 30223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:22.137274 30223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:06:22.138725 30223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:38929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:22.138988 30223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:22.139214 30223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:22.144016 30231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:22.144027 30229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:22.144025 30228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:22.144259 30223 server_base.cc:1034] running on GCE node
I20260811 10:06:22.144457 30223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:22.144734 30223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:22.145907 30223 hybrid_clock.cc:648] HybridClock initialized: now 1786442782145893 us; error 34 us; skew 500 ppm
Aug 11 10:06:22 dist-test-slave-1x4g krb5kdc[29814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442782, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:22.148488 30223 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:06:22.149045 30223 webserver.cc:460] Webserver started at http://127.9.127.195:46635/ using document root <none> and password file <none>
I20260811 10:06:22.149292 30223 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:22.149360 30223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:22.149503 30223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:22.150698 30223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "89cedf99ccdc496da3d1e2757ee0084a"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "fa34c3a5803a3edaf18b4c0b98e1aa1c"
server_key_iv: "6b17e79aaf56f295dba5a3f04ded23d2"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.151144 30223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "89cedf99ccdc496da3d1e2757ee0084a"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "fa34c3a5803a3edaf18b4c0b98e1aa1c"
server_key_iv: "6b17e79aaf56f295dba5a3f04ded23d2"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.152555 30223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:22.153398 30239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.153565 30223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.153666 30223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "89cedf99ccdc496da3d1e2757ee0084a"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "fa34c3a5803a3edaf18b4c0b98e1aa1c"
server_key_iv: "6b17e79aaf56f295dba5a3f04ded23d2"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.153764 30223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:22.163376 30223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:22.165788 30223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:22.165953 30223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:22.166191 30223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:22.166497 30223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:22.166551 30223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.166584 30223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:22.166615 30223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.172801 30223 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:33279
I20260811 10:06:22.172861 30360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:33279 every 8 connection(s)
I20260811 10:06:22.173158 30223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
Aug 11 10:06:22 dist-test-slave-1x4g krb5kdc[29814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442782, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:22.180858 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 30223
I20260811 10:06:22.180971 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:06:22.181206 9727 external_mini_cluster.cc:1428] Setting key d01ee98faa1014f0dba16621b2cb8036
I20260811 10:06:22.182227 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.173831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:52845 (local address 127.9.127.254:38929)
0811 10:06:22.173908 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.173911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.174063 (+ 152us) server_negotiation.cc:407] Connection header received
0811 10:06:22.174543 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.174544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.174554 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.174605 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:22.175496 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.175986 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.177014 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.177196 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.177248 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.179259 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:22.179261 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:22.179261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:22.179268 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:22.180477 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:22.181054 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:22.181055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:22.181056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:22.181127 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:22.181423 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:22.181425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:22.181425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:22.181617 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:22.181695 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.182046 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.182134 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 10:06:22.182375 30363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.173783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:38929 (local address 127.9.127.195:52845)
0811 10:06:22.173943 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.173978 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.174445 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.174657 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.174660 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.175234 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:22.175416 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.175421 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.176067 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.176068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.176941 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.176943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.177268 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.177268 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.177364 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.177858 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:22.177866 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:22.179176 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:22.180550 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:22.180556 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:22.180558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:22.180924 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:22.181199 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:22.181200 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:22.181200 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:22.181340 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:22.181696 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:22.181703 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:22.181877 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.181998 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.182155 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":97,"threads_started":1}
I20260811 10:06:22.182801 30361 heartbeater.cc:347] Connected to a master server at 127.9.127.254:38929
I20260811 10:06:22.182911 30361 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:22.183089 30361 heartbeater.cc:511] Master 127.9.127.254:38929 requested a full tablet report, sending...
I20260811 10:06:22.183465 29862 ts_manager.cc:194] Registered new tserver with Master: 89cedf99ccdc496da3d1e2757ee0084a (127.9.127.195:33279)
I20260811 10:06:22.183789 29862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:52845
I20260811 10:06:22.193199 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:06:22.200661 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.194553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50392 (local address 127.9.127.254:38929)
0811 10:06:22.194636 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.194639 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.194739 (+ 100us) server_negotiation.cc:407] Connection header received
0811 10:06:22.194831 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.194832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.194844 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.194908 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:22.195474 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.195961 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.196718 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.196959 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.197030 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.198313 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:22.198315 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:22.198315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:22.198322 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:22.199455 (+ 1133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:22.199842 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:22.199844 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:22.199844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:22.199902 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:22.200123 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:22.200124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:22.200124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:22.200260 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:22.200376 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.200496 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.200555 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 10:06:22.202397 29862 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:06:22.204005 29862 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:06:22.210835 30372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.206240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:41135 (local address 127.0.0.1:34974)
0811 10:06:22.206395 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.206430 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.206502 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.206912 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.206916 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.206918 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:22.206985 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.206988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.208456 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.208456 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.209604 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.209607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.210564 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.210565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.210635 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.210640 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.210685 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.210743 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":56,"threads_started":1}
I20260811 10:06:22.210909 30377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.206639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51766 (local address 127.9.127.195:33279)
0811 10:06:22.206904 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.206909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.206919 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:22.206956 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.206958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.206972 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.207078 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:22.207273 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.208344 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.209942 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.210431 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.210535 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.210609 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.210756 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.210797 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":86,"threads_started":1}
I20260811 10:06:22.210927 30373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.206435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:33279 (local address 127.0.0.1:51766)
0811 10:06:22.206563 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.206585 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.206637 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.207156 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.207157 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.207159 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:22.207195 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.207196 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.208850 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.208851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.209859 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.209861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.210540 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.210542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.210623 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.210637 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.210736 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.210783 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
I20260811 10:06:22.211326 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.206336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34974 (local address 127.9.127.194:41135)
0811 10:06:22.206653 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.206657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.206666 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:06:22.206710 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.206711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.206724 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.206892 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:22.207211 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.208353 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.209697 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.210440 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.211104 (+ 664us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.211174 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.211200 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.211241 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":71,"threads_started":1}
I20260811 10:06:22.211880 30291 tablet_service.cc:1467] Processing CreateTablet for tablet 473fd642788b46bab902a7dba6cc04b3 (DEFAULT_TABLE table=test-table [id=38208b8b30eb43169fe79df2dfd44cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:22.211962 30146 tablet_service.cc:1467] Processing CreateTablet for tablet 473fd642788b46bab902a7dba6cc04b3 (DEFAULT_TABLE table=test-table [id=38208b8b30eb43169fe79df2dfd44cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:22.212263 30376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.206242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:35087 (local address 127.0.0.1:50810)
0811 10:06:22.206545 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.206554 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.206599 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.207063 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.207065 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.207067 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:22.207121 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.207122 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.209477 (+ 2355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.209478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.210579 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.210581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.212034 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.212036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.212116 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.212120 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.212160 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.212198 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":95,"threads_started":1}
I20260811 10:06:22.212284 30291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 473fd642788b46bab902a7dba6cc04b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:22.212284 30146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 473fd642788b46bab902a7dba6cc04b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:22.212520 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.206380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50810 (local address 127.9.127.193:35087)
0811 10:06:22.206894 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.206899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.206909 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:22.206948 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.206950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.206967 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.207056 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:22.208484 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.209381 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.210667 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.211918 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.212025 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.212209 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.212236 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.212276 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":78,"threads_started":1}
I20260811 10:06:22.213348 30002 tablet_service.cc:1467] Processing CreateTablet for tablet 473fd642788b46bab902a7dba6cc04b3 (DEFAULT_TABLE table=test-table [id=38208b8b30eb43169fe79df2dfd44cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:22.213675 30002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 473fd642788b46bab902a7dba6cc04b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:22.215782 30379 tablet_bootstrap.cc:492] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Bootstrap starting.
I20260811 10:06:22.216085 30380 tablet_bootstrap.cc:492] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf: Bootstrap starting.
I20260811 10:06:22.216238 30378 tablet_bootstrap.cc:492] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Bootstrap starting.
I20260811 10:06:22.216722 30380 tablet_bootstrap.cc:654] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:22.216748 30378 tablet_bootstrap.cc:654] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:22.217248 30380 log.cc:824] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:22.217260 30378 log.cc:824] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:22.217898 30379 tablet_bootstrap.cc:654] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:22.218003 30378 tablet_bootstrap.cc:492] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: No bootstrap required, opened a new log
I20260811 10:06:22.218080 30378 ts_tablet_manager.cc:1397] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 10:06:22.218191 30380 tablet_bootstrap.cc:492] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf: No bootstrap required, opened a new log
I20260811 10:06:22.218262 30380 ts_tablet_manager.cc:1397] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:06:22.218498 30379 log.cc:824] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:22.219266 30379 tablet_bootstrap.cc:492] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: No bootstrap required, opened a new log
I20260811 10:06:22.219331 30379 ts_tablet_manager.cc:1397] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 10:06:22.220084 30380 raft_consensus.cc:348] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.220095 30378 raft_consensus.cc:348] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.220264 30378 raft_consensus.cc:374] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:22.220264 30380 raft_consensus.cc:374] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:22.220309 30378 raft_consensus.cc:729] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 343f96f55dcc4e628bc91d7faf98a917, State: Initialized, Role: FOLLOWER
I20260811 10:06:22.220310 30380 raft_consensus.cc:729] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640b057f636f4d679d17aca001441cdf, State: Initialized, Role: FOLLOWER
I20260811 10:06:22.220422 30380 consensus_queue.cc:260] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.220436 30378 consensus_queue.cc:260] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.220755 30378 ts_tablet_manager.cc:1428] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 10:06:22.220758 30380 ts_tablet_manager.cc:1428] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:06:22.220817 30218 heartbeater.cc:503] Master 127.9.127.254:38929 was elected leader, sending a full tablet report...
I20260811 10:06:22.220922 30071 heartbeater.cc:503] Master 127.9.127.254:38929 was elected leader, sending a full tablet report...
I20260811 10:06:22.221385 30379 raft_consensus.cc:348] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.221534 30379 raft_consensus.cc:374] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:22.221582 30379 raft_consensus.cc:729] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89cedf99ccdc496da3d1e2757ee0084a, State: Initialized, Role: FOLLOWER
I20260811 10:06:22.221704 30379 consensus_queue.cc:260] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.222018 30379 ts_tablet_manager.cc:1428] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:06:22.222085 30361 heartbeater.cc:503] Master 127.9.127.254:38929 was elected leader, sending a full tablet report...
W20260811 10:06:22.272588 30219 tablet.cc:2369] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:06:22.377624 30072 tablet.cc:2369] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:06:22.393254 30386 raft_consensus.cc:482] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:22.393378 30386 raft_consensus.cc:504] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.393779 30386 leader_election.cc:288] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 343f96f55dcc4e628bc91d7faf98a917 (127.9.127.194:41135), 89cedf99ccdc496da3d1e2757ee0084a (127.9.127.195:33279)
I20260811 10:06:22.397869 30377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.394096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:42999 (local address 127.9.127.195:33279)
0811 10:06:22.394143 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.394145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.394179 (+ 34us) server_negotiation.cc:407] Connection header received
0811 10:06:22.394269 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.394270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.394280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.394352 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:22.394565 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.395306 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.396906 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.397483 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.397565 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.397583 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.397761 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.397801 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:06:22.397869 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.394094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:47133 (local address 127.9.127.194:41135)
0811 10:06:22.394143 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.394145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.394176 (+ 31us) server_negotiation.cc:407] Connection header received
0811 10:06:22.394269 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.394270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.394280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.394352 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:22.394556 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.395321 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.396906 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.397483 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.397565 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.397574 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.397761 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.397800 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 10:06:22.397897 30389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.393967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:33279 (local address 127.9.127.193:42999)
0811 10:06:22.394110 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.394121 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.394190 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.394369 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.394370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.394373 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:22.394488 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.394489 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.395397 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.395398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.396818 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.396821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.397575 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.397576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.397671 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.397677 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.397736 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.397786 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":105,"thread_start_us":71,"threads_started":1}
I20260811 10:06:22.397899 30388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.393972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:41135 (local address 127.9.127.193:47133)
0811 10:06:22.394108 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.394121 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.394190 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.394387 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.394388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.394390 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:22.394455 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.394458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.395397 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.395398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.396818 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.396821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.397576 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.397577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.397671 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.397678 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.397736 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.397786 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":85,"spinlock_wait_cycles":16768,"thread_start_us":79,"threads_started":1}
I20260811 10:06:22.398262 30314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "473fd642788b46bab902a7dba6cc04b3" candidate_uuid: "640b057f636f4d679d17aca001441cdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89cedf99ccdc496da3d1e2757ee0084a" is_pre_election: true
I20260811 10:06:22.398423 30314 raft_consensus.cc:2454] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 640b057f636f4d679d17aca001441cdf in term 0.
I20260811 10:06:22.398473 30168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "473fd642788b46bab902a7dba6cc04b3" candidate_uuid: "640b057f636f4d679d17aca001441cdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343f96f55dcc4e628bc91d7faf98a917" is_pre_election: true
I20260811 10:06:22.398634 30168 raft_consensus.cc:2454] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 640b057f636f4d679d17aca001441cdf in term 0.
I20260811 10:06:22.398674 29952 leader_election.cc:302] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 640b057f636f4d679d17aca001441cdf, 89cedf99ccdc496da3d1e2757ee0084a; no voters:
I20260811 10:06:22.398773 30386 raft_consensus.cc:2781] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:06:22.398823 30386 raft_consensus.cc:482] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:06:22.398876 30386 raft_consensus.cc:3037] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:22.399590 30386 raft_consensus.cc:504] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.399731 30386 leader_election.cc:288] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [CANDIDATE]: Term 1 election: Requested vote from peers 343f96f55dcc4e628bc91d7faf98a917 (127.9.127.194:41135), 89cedf99ccdc496da3d1e2757ee0084a (127.9.127.195:33279)
I20260811 10:06:22.399888 30168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "473fd642788b46bab902a7dba6cc04b3" candidate_uuid: "640b057f636f4d679d17aca001441cdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "343f96f55dcc4e628bc91d7faf98a917"
I20260811 10:06:22.399962 30168 raft_consensus.cc:3037] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:22.400646 30168 raft_consensus.cc:2454] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640b057f636f4d679d17aca001441cdf in term 1.
I20260811 10:06:22.400763 30314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "473fd642788b46bab902a7dba6cc04b3" candidate_uuid: "640b057f636f4d679d17aca001441cdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89cedf99ccdc496da3d1e2757ee0084a"
I20260811 10:06:22.400851 29951 leader_election.cc:302] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 343f96f55dcc4e628bc91d7faf98a917, 640b057f636f4d679d17aca001441cdf; no voters:
I20260811 10:06:22.400861 30314 raft_consensus.cc:3037] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:22.400938 30386 raft_consensus.cc:2781] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:22.401109 30386 raft_consensus.cc:686] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [term 1 LEADER]: Becoming Leader. State: Replica: 640b057f636f4d679d17aca001441cdf, State: Running, Role: LEADER
I20260811 10:06:22.401229 30386 consensus_queue.cc:237] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } }
I20260811 10:06:22.402035 30314 raft_consensus.cc:2454] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 640b057f636f4d679d17aca001441cdf in term 1.
I20260811 10:06:22.402269 29862 catalog_manager.cc:5495] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf reported cstate change: term changed from 0 to 1, leader changed from <none> to 640b057f636f4d679d17aca001441cdf (127.9.127.193). New cstate: current_term: 1 leader_uuid: "640b057f636f4d679d17aca001441cdf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "640b057f636f4d679d17aca001441cdf" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 35087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 } health_report { overall_health: UNKNOWN } } }
W20260811 10:06:22.423661 30362 tablet.cc:2369] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:06:22.437237 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.434869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50812 (local address 127.9.127.193:35087)
0811 10:06:22.434946 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.434948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.434957 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:06:22.434993 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.434994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.435020 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.435080 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:22.435217 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.435662 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.436352 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.436536 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.436590 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.436847 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:22.436958 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:22.437038 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.437114 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.437146 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 10:06:22.439051 30314 raft_consensus.cc:1261] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 1 FOLLOWER]: Refusing update from remote peer 640b057f636f4d679d17aca001441cdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:22.439052 30168 raft_consensus.cc:1261] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 1 FOLLOWER]: Refusing update from remote peer 640b057f636f4d679d17aca001441cdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:22.439405 30391 consensus_queue.cc:1035] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "89cedf99ccdc496da3d1e2757ee0084a" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:22.439514 30386 consensus_queue.cc:1035] T 473fd642788b46bab902a7dba6cc04b3 P 640b057f636f4d679d17aca001441cdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "343f96f55dcc4e628bc91d7faf98a917" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 41135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:22.442001 30396 mvcc.cc:205] Tried to move back new op lower bound from 7317269636867579904 to 7317269636716175360. Current Snapshot: MvccSnapshot[applied={T|T < 7317269636867579904}]
I20260811 10:06:22.442514 30395 mvcc.cc:205] Tried to move back new op lower bound from 7317269636867579904 to 7317269636716175360. Current Snapshot: MvccSnapshot[applied={T|T < 7317269636867579904 or (T in {7317269636867579904})}]
I20260811 10:06:22.442579 30397 mvcc.cc:205] Tried to move back new op lower bound from 7317269636867579904 to 7317269636716175360. Current Snapshot: MvccSnapshot[applied={T|T < 7317269636867579904}]
I20260811 10:06:22.444186 29861 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:22.444283 29861 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:22.445050 29861 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d03b871a2d294adfbd55af72510ee622: Sending DeleteTablet for 3 replicas of tablet 473fd642788b46bab902a7dba6cc04b3
I20260811 10:06:22.445384 30002 tablet_service.cc:1514] Processing DeleteTablet for tablet 473fd642788b46bab902a7dba6cc04b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:22 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:50810
I20260811 10:06:22.445446 30291 tablet_service.cc:1514] Processing DeleteTablet for tablet 473fd642788b46bab902a7dba6cc04b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:22 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:51766
I20260811 10:06:22.445647 30146 tablet_service.cc:1514] Processing DeleteTablet for tablet 473fd642788b46bab902a7dba6cc04b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:22 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:34974
I20260811 10:06:22.445727 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 29930
I20260811 10:06:22.445859 30406 tablet_replica.cc:330] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: stopping tablet replica
I20260811 10:06:22.445942 30406 raft_consensus.cc:2229] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:22.446029 30406 raft_consensus.cc:2258] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:22.446341 30408 tablet_replica.cc:330] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: stopping tablet replica
I20260811 10:06:22.446419 30408 raft_consensus.cc:2229] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:22.446489 30408 raft_consensus.cc:2258] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:22.447206 30408 ts_tablet_manager.cc:1905] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:22.447995 30406 ts_tablet_manager.cc:1905] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:22.449955 30406 ts_tablet_manager.cc:1918] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:22.450034 30406 log.cc:1196] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/473fd642788b46bab902a7dba6cc04b3
I20260811 10:06:22.450330 30406 ts_tablet_manager.cc:1939] T 473fd642788b46bab902a7dba6cc04b3 P 89cedf99ccdc496da3d1e2757ee0084a: Deleting consensus metadata
I20260811 10:06:22.450891 29849 catalog_manager.cc:4841] TS 89cedf99ccdc496da3d1e2757ee0084a (127.9.127.195:33279): tablet 473fd642788b46bab902a7dba6cc04b3 (table test-table [id=38208b8b30eb43169fe79df2dfd44cb0]) successfully deleted
W20260811 10:06:22.454877 29849 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:35087 (error 108)
I20260811 10:06:22.454965 30408 ts_tablet_manager.cc:1918] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:22.455098 30408 log.cc:1196] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/473fd642788b46bab902a7dba6cc04b3
I20260811 10:06:22.455154 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 30076
I20260811 10:06:22.455375 30408 ts_tablet_manager.cc:1939] T 473fd642788b46bab902a7dba6cc04b3 P 343f96f55dcc4e628bc91d7faf98a917: Deleting consensus metadata
I20260811 10:06:22.456017 30376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.455295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:35087 (local address 127.0.0.1:50826)
0811 10:06:22.455933 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.455977 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:35087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":605}
W20260811 10:06:22.456337 29849 catalog_manager.cc:4584] TS 640b057f636f4d679d17aca001441cdf (127.9.127.193:35087): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 473fd642788b46bab902a7dba6cc04b3: Network error: Client connection negotiation failed: client connection to 127.9.127.193:35087: connect: Connection refused (error 111)
I20260811 10:06:22.461113 30376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.460994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:41135 (local address 127.0.0.1:34976)
0811 10:06:22.461050 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.461078 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.194:41135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 10:06:22.461225 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 30223
I20260811 10:06:22.466756 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 29829
2026-08-11T10:06:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2141 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T10:06:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:22Z Disabled control of system clock
I20260811 10:06:22.496197 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:34975
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:41111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:34975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:22.577167 30413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:22.577368 30413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:22.577387 30413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:22.578506 30413 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:22.578544 30413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:22.578557 30413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:22.578600 30413 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:22.578617 30413 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:22.579890 30413 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:34975
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:34975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:22.580140 30413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:22.580439 30413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:22.585193 30419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:22.585229 30422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:22.585206 30420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:22.585415 30413 server_base.cc:1034] running on GCE node
I20260811 10:06:22.585686 30413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:22.585947 30413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:22.587101 30413 hybrid_clock.cc:648] HybridClock initialized: now 1786442782587094 us; error 27 us; skew 500 ppm
I20260811 10:06:22.588348 30413 webserver.cc:460] Webserver started at http://127.9.127.254:35977/ using document root <none> and password file <none>
I20260811 10:06:22.588613 30413 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:22.588660 30413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:22.588836 30413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:22.589838 30413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "2bc56656b7e4488eb7d222c2bfa3188b"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "440f1252d519dc7573e89245fc58398b"
server_key_iv: "79fd9b8b9f53037d1f46490d5903432f"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.590119 30413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "2bc56656b7e4488eb7d222c2bfa3188b"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "440f1252d519dc7573e89245fc58398b"
server_key_iv: "79fd9b8b9f53037d1f46490d5903432f"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.591356 30413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:22.592034 30430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.592208 30413 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:22.592289 30413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "2bc56656b7e4488eb7d222c2bfa3188b"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "440f1252d519dc7573e89245fc58398b"
server_key_iv: "79fd9b8b9f53037d1f46490d5903432f"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.592358 30413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:22.605825 30413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:22.606078 30413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:22.606170 30413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:22.609889 30413 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:34975
I20260811 10:06:22.609959 30488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:34975 every 8 connection(s)
I20260811 10:06:22.610277 30413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:22.610736 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 30413
I20260811 10:06:22.610877 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:22.611084 9727 external_mini_cluster.cc:1428] Setting key 6e253878ff33f65f59c2b86fd67213a1
I20260811 10:06:22.611394 30489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:22.614112 30489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b: Bootstrap starting.
I20260811 10:06:22.614697 30489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:22.614979 30489 log.cc:824] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:22.615684 30489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b: No bootstrap required, opened a new log
I20260811 10:06:22.616432 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.611582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50886 (local address 127.9.127.254:34975)
0811 10:06:22.611811 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.611823 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.611846 (+ 23us) server_negotiation.cc:407] Connection header received
0811 10:06:22.612417 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.612424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.612493 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.612633 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:22.612856 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.613692 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.614581 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.615024 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.615152 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.615834 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:22.615839 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:22.615839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:22.615992 (+ 153us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:22.616023 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:22.616033 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:22.616106 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.616196 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.616273 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
I20260811 10:06:22.617882 30489 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bc56656b7e4488eb7d222c2bfa3188b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34975 } }
I20260811 10:06:22.618034 30489 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:22.618090 30489 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bc56656b7e4488eb7d222c2bfa3188b, State: Initialized, Role: FOLLOWER
I20260811 10:06:22.618216 30489 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bc56656b7e4488eb7d222c2bfa3188b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34975 } }
I20260811 10:06:22.618314 30489 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:22.618358 30489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:22.618409 30489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:22.618973 30489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bc56656b7e4488eb7d222c2bfa3188b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34975 } }
I20260811 10:06:22.619151 30489 leader_election.cc:302] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bc56656b7e4488eb7d222c2bfa3188b; no voters:
I20260811 10:06:22.619336 30489 leader_election.cc:288] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:22.619385 30494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:22.619557 30494 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [term 1 LEADER]: Becoming Leader. State: Replica: 2bc56656b7e4488eb7d222c2bfa3188b, State: Running, Role: LEADER
I20260811 10:06:22.619607 30489 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:22.619689 30494 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bc56656b7e4488eb7d222c2bfa3188b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34975 } }
I20260811 10:06:22.620074 30495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bc56656b7e4488eb7d222c2bfa3188b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bc56656b7e4488eb7d222c2bfa3188b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34975 } } }
I20260811 10:06:22.620076 30496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bc56656b7e4488eb7d222c2bfa3188b. Latest consensus state: current_term: 1 leader_uuid: "2bc56656b7e4488eb7d222c2bfa3188b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bc56656b7e4488eb7d222c2bfa3188b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34975 } } }
I20260811 10:06:22.620205 30495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:22.620410 30502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:22.620213 30496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:22.621027 30502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:22.622458 30502 catalog_manager.cc:1347] Generated new cluster ID: 62c81d87af3e4135bda9625c96f1eae4
I20260811 10:06:22.622516 30502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:22.627991 30502 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:22.628461 30502 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:22.631448 30502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b: Generated new TSK 0
I20260811 10:06:22.631603 30502 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:22.641224 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:34975
--builtin_ntp_servers=127.9.127.212:41111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:22.730585 30513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:22.730779 30513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:22.730801 30513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:22.731933 30513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:22.731972 30513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:22.731997 30513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:06:22.733402 30513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:34975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:22.733664 30513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:22.733973 30513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:22.739805 30521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:22.739745 30519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:22.739738 30518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:22.740052 30513 server_base.cc:1034] running on GCE node
I20260811 10:06:22.740278 30513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:22.740548 30513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:22.741708 30513 hybrid_clock.cc:648] HybridClock initialized: now 1786442782741685 us; error 41 us; skew 500 ppm
I20260811 10:06:22.742969 30513 webserver.cc:460] Webserver started at http://127.9.127.193:42605/ using document root <none> and password file <none>
I20260811 10:06:22.743247 30513 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:22.743291 30513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:22.743436 30513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:22.744467 30513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "cbda212f121049088d5289f2ccc3dcce"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "e02430879818613fdd86eb26bd1537ba"
server_key_iv: "a7b3c5a69720b0e9d9de46fdc7134495"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.744887 30513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "cbda212f121049088d5289f2ccc3dcce"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "e02430879818613fdd86eb26bd1537ba"
server_key_iv: "a7b3c5a69720b0e9d9de46fdc7134495"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.746340 30513 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:22.747174 30528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.747326 30513 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:22.747416 30513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "cbda212f121049088d5289f2ccc3dcce"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "e02430879818613fdd86eb26bd1537ba"
server_key_iv: "a7b3c5a69720b0e9d9de46fdc7134495"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.747486 30513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:22.765204 30513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:22.765494 30513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:22.765645 30513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:22.765865 30513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:22.766196 30513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:22.766232 30513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.766251 30513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:22.766296 30513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.773355 30513 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:36451
I20260811 10:06:22.773432 30652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:36451 every 8 connection(s)
I20260811 10:06:22.773777 30513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:06:22.777472 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 30513
I20260811 10:06:22.777604 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:06:22.777810 9727 external_mini_cluster.cc:1428] Setting key ca0e1aadb2324b15f7acc10c973f1d90
I20260811 10:06:22.778792 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:34975
--builtin_ntp_servers=127.9.127.212:41111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 10:06:22.779466 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.774540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:38693 (local address 127.9.127.254:34975)
0811 10:06:22.774607 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.774609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.774882 (+ 273us) server_negotiation.cc:407] Connection header received
0811 10:06:22.775463 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.775465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.775481 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.775533 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:22.776223 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.776750 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.777919 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.778146 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.778225 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.779163 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:22.779165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:22.779165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:22.779170 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:22.779191 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:22.779195 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:22.779256 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.779357 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.779386 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:06:22.779693 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.774528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:34975 (local address 127.9.127.193:38693)
0811 10:06:22.774736 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.774786 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.775330 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.775604 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.775607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.775615 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:22.776123 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.776128 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.776912 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.776913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.777816 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.777819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.778236 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.778237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.778376 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.778989 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:22.778989 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:22.779028 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:22.779059 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:22.779259 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:22.779267 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:22.779270 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.779360 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.779468 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":102,"threads_started":1}
I20260811 10:06:22.780812 30653 heartbeater.cc:347] Connected to a master server at 127.9.127.254:34975
I20260811 10:06:22.780908 30653 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:22.781097 30653 heartbeater.cc:511] Master 127.9.127.254:34975 requested a full tablet report, sending...
I20260811 10:06:22.781708 30451 ts_manager.cc:194] Registered new tserver with Master: cbda212f121049088d5289f2ccc3dcce (127.9.127.193:36451)
I20260811 10:06:22.782349 30451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.193:38693
W20260811 10:06:22.864409 30656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:22.864606 30656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:22.864627 30656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:22.865840 30656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:22.865881 30656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:22.865906 30656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:06:22.867224 30656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:34975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:22.867449 30656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:22.867739 30656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:22.872473 30665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:22.872614 30656 server_base.cc:1034] running on GCE node
W20260811 10:06:22.872473 30662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:22.872516 30663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:22.872938 30656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:22.873164 30656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:22.874322 30656 hybrid_clock.cc:648] HybridClock initialized: now 1786442782874311 us; error 41 us; skew 500 ppm
I20260811 10:06:22.875648 30656 webserver.cc:460] Webserver started at http://127.9.127.194:43377/ using document root <none> and password file <none>
I20260811 10:06:22.875890 30656 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:22.875958 30656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:22.876118 30656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:22.877257 30656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "874b73d57ed2431aa29c9c64ce09448e"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "b1351ac8b38c540189bd659e73580fc2"
server_key_iv: "bfb0739d3dba717c0c9ca6ff96feb19f"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.877624 30656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "874b73d57ed2431aa29c9c64ce09448e"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "b1351ac8b38c540189bd659e73580fc2"
server_key_iv: "bfb0739d3dba717c0c9ca6ff96feb19f"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.878899 30656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:22.879593 30673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.879774 30656 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:22.879866 30656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "874b73d57ed2431aa29c9c64ce09448e"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "b1351ac8b38c540189bd659e73580fc2"
server_key_iv: "bfb0739d3dba717c0c9ca6ff96feb19f"
server_key_version: "encryptionkey@0"
I20260811 10:06:22.879948 30656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:22.889719 30656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:22.889981 30656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:22.890126 30656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:22.890345 30656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:22.890692 30656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:22.890748 30656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.890787 30656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:22.890815 30656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:22.896865 30656 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:40581
I20260811 10:06:22.896898 30800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:40581 every 8 connection(s)
I20260811 10:06:22.897217 30656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:06:22.902294 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.897943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:55659 (local address 127.9.127.254:34975)
0811 10:06:22.897991 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:22.897993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:22.898227 (+ 234us) server_negotiation.cc:407] Connection header received
0811 10:06:22.898745 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:22.898746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:22.898761 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:22.898815 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:22.899493 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.899994 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.900974 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.901184 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.901257 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.901990 (+ 733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:22.901992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:22.901992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:22.901997 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:22.902012 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:22.902016 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:22.902089 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:22.902188 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 10:06:22.902216 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 10:06:22.902511 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:22.897890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:34975 (local address 127.9.127.194:55659)
0811 10:06:22.898072 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:22.898117 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:22.898636 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:22.898878 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:22.898882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:22.898892 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:22.899391 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.899395 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.900101 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.900103 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.900879 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:22.900881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:22.901280 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:22.901281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:22.901408 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:22.901849 (+ 441us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:22.901849 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:22.901876 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:22.901897 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:22.902093 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:22.902099 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:22.902103 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:22.902188 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 10:06:22.902287 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260811 10:06:22.903024 30801 heartbeater.cc:347] Connected to a master server at 127.9.127.254:34975
I20260811 10:06:22.903105 30801 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:22.903241 30801 heartbeater.cc:511] Master 127.9.127.254:34975 requested a full tablet report, sending...
I20260811 10:06:22.903563 30451 ts_manager.cc:194] Registered new tserver with Master: 874b73d57ed2431aa29c9c64ce09448e (127.9.127.194:40581)
I20260811 10:06:22.903936 30451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.194:55659
I20260811 10:06:22.905766 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 30656
I20260811 10:06:22.905848 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:06:22.906011 9727 external_mini_cluster.cc:1428] Setting key 9b1f30e299a67e2ba3974fb4597225e8
I20260811 10:06:22.906862 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:34975
--builtin_ntp_servers=127.9.127.212:41111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:22.988562 30805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:22.988780 30805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:22.988881 30805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:22.990020 30805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:22.990057 30805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:22.990082 30805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:06:22.991405 30805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:34975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:22.991680 30805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:22.991974 30805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:22.996996 30814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:22.997002 30812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:22.997174 30805 server_base.cc:1034] running on GCE node
W20260811 10:06:22.997002 30810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:22.997457 30805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:22.997687 30805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:22.998847 30805 hybrid_clock.cc:648] HybridClock initialized: now 1786442782998833 us; error 44 us; skew 500 ppm
I20260811 10:06:23.000084 30805 webserver.cc:460] Webserver started at http://127.9.127.195:38735/ using document root <none> and password file <none>
I20260811 10:06:23.000336 30805 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:23.000406 30805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:23.000561 30805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:23.001645 30805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "e531442910034c2ba2751f21ba4b3278"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "87b2e0d364a427609cb6bb18c12d9854"
server_key_iv: "9ce32fa989302b259a1382c2726fe93e"
server_key_version: "encryptionkey@0"
I20260811 10:06:23.002005 30805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "e531442910034c2ba2751f21ba4b3278"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "87b2e0d364a427609cb6bb18c12d9854"
server_key_iv: "9ce32fa989302b259a1382c2726fe93e"
server_key_version: "encryptionkey@0"
I20260811 10:06:23.003301 30805 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:06:23.003993 30820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:23.004175 30805 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:23.004271 30805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "e531442910034c2ba2751f21ba4b3278"
format_stamp: "Formatted at 2026-08-11 10:06:22 on dist-test-slave-1x4g"
server_key: "87b2e0d364a427609cb6bb18c12d9854"
server_key_iv: "9ce32fa989302b259a1382c2726fe93e"
server_key_version: "encryptionkey@0"
I20260811 10:06:23.004347 30805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:23.021952 30805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:23.022244 30805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:23.022413 30805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:23.022650 30805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:23.022986 30805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:23.023039 30805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:23.023072 30805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:23.023100 30805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:23.028743 30805 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:43593
I20260811 10:06:23.028813 30945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:43593 every 8 connection(s)
I20260811 10:06:23.029136 30805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:06:23.032270 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 30805
I20260811 10:06:23.032405 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:06:23.032613 9727 external_mini_cluster.cc:1428] Setting key ad98caf94e8e0d4ab69c9132eb07b27e
I20260811 10:06:23.034896 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.029868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:59519 (local address 127.9.127.254:34975)
0811 10:06:23.029919 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:23.029921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:23.030328 (+ 407us) server_negotiation.cc:407] Connection header received
0811 10:06:23.030813 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:23.030815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:23.030828 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:23.030902 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:23.031531 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.032032 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.033476 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.033737 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.033800 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.034627 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:23.034628 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:23.034629 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:23.034634 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:23.034648 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:23.034652 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:23.034700 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:23.034790 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 10:06:23.034817 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 10:06:23.035131 30949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.029866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:34975 (local address 127.9.127.195:59519)
0811 10:06:23.030201 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:23.030236 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:23.030723 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:23.030952 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:23.030955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:23.030963 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:23.031459 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.031463 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.032239 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.032240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.033386 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.033389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.033808 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.033809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.033950 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.034487 (+ 537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:23.034488 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:23.034517 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:23.034539 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:23.034700 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:23.034706 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:23.034708 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:06:23.034792 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 10:06:23.034893 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":209,"threads_started":1}
I20260811 10:06:23.035629 30946 heartbeater.cc:347] Connected to a master server at 127.9.127.254:34975
I20260811 10:06:23.035739 30946 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:23.035941 30946 heartbeater.cc:511] Master 127.9.127.254:34975 requested a full tablet report, sending...
I20260811 10:06:23.036317 30451 ts_manager.cc:194] Registered new tserver with Master: e531442910034c2ba2751f21ba4b3278 (127.9.127.195:43593)
I20260811 10:06:23.036684 30451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.195:59519
I20260811 10:06:23.044726 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:06:23.048748 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.046139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50888 (local address 127.9.127.254:34975)
0811 10:06:23.046200 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:23.046202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:23.046255 (+ 53us) server_negotiation.cc:407] Connection header received
0811 10:06:23.046318 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:23.046318 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:23.046327 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:23.046370 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:23.046525 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.046988 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.047691 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.047863 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.047925 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.048524 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:23.048525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:23.048525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:23.048530 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:23.048543 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:23.048546 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:23.048620 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:23.048689 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 10:06:23.048699 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:06:23.050225 30451 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:06:23.051769 30451 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:06:23.058108 30958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.053936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:36451 (local address 127.0.0.1:49220)
0811 10:06:23.054384 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:23.054394 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:23.054430 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:23.054947 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:23.054948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:23.054950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:23.054985 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.054986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.055927 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.055929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.056892 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.056895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.057783 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.057785 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.057860 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.057874 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 10:06:23.057944 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 10:06:23.058016 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"spinlock_wait_cycles":896,"thread_start_us":116,"threads_started":1}
I20260811 10:06:23.058169 30959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.054020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49220 (local address 127.9.127.193:36451)
0811 10:06:23.054742 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:23.054746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:23.054757 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:06:23.054802 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:23.054804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:23.054821 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:23.054923 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:23.055079 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.055811 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.056996 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.057686 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.057774 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.057865 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:23.057987 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 10:06:23.058050 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":95,"threads_started":1}
I20260811 10:06:23.058534 30960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.054221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46306 (local address 127.9.127.195:43593)
0811 10:06:23.054398 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:23.054404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:23.054417 (+ 13us) server_negotiation.cc:407] Connection header received
0811 10:06:23.054460 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:23.054462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:23.054480 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:23.054603 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:23.054752 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.055828 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.057278 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.058007 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.058115 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.058199 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:23.058424 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 10:06:23.058461 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":85,"threads_started":1}
I20260811 10:06:23.058530 30956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.053931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43593 (local address 127.0.0.1:46306)
0811 10:06:23.054237 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:23.054246 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:23.054287 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:23.054610 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:23.054614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:23.054616 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:23.054686 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.054688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.055922 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.055923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.057186 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.057190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.058243 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.058245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.058312 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.058316 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:23.058404 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 10:06:23.058445 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":37,"thread_start_us":70,"threads_started":1}
I20260811 10:06:23.058784 30957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.053931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:40581 (local address 127.0.0.1:53158)
0811 10:06:23.054146 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:23.054216 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:23.054284 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:23.055006 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:23.055007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:23.055009 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:23.055074 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.055076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.056301 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.056302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.057404 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.057406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.058395 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.058396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.058607 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.058612 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:06:23.058667 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 10:06:23.058710 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":1,"thread_start_us":82,"threads_started":1}
I20260811 10:06:23.058831 30961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.054239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53158 (local address 127.9.127.194:40581)
0811 10:06:23.054452 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:23.054456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:23.054466 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:23.054507 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:23.054509 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:23.054524 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:23.054603 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:23.055166 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.056214 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.057487 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.058200 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.058279 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.058361 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:23.058694 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 10:06:23.058743 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":81,"threads_started":1}
I20260811 10:06:23.059131 30583 tablet_service.cc:1467] Processing CreateTablet for tablet c01376aaa9b5438fa21106bba4328333 (DEFAULT_TABLE table=test-table [id=1060c6f636034d31a2a87898eacdef07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:23.059247 30871 tablet_service.cc:1467] Processing CreateTablet for tablet c01376aaa9b5438fa21106bba4328333 (DEFAULT_TABLE table=test-table [id=1060c6f636034d31a2a87898eacdef07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:23.059412 30583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c01376aaa9b5438fa21106bba4328333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:23.059517 30871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c01376aaa9b5438fa21106bba4328333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:23.061231 30729 tablet_service.cc:1467] Processing CreateTablet for tablet c01376aaa9b5438fa21106bba4328333 (DEFAULT_TABLE table=test-table [id=1060c6f636034d31a2a87898eacdef07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:23.061579 30729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c01376aaa9b5438fa21106bba4328333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:23.062036 30962 tablet_bootstrap.cc:492] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: Bootstrap starting.
I20260811 10:06:23.062681 30962 tablet_bootstrap.cc:654] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:23.062932 30962 log.cc:824] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:23.063159 30963 tablet_bootstrap.cc:492] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce: Bootstrap starting.
I20260811 10:06:23.063637 30962 tablet_bootstrap.cc:492] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: No bootstrap required, opened a new log
I20260811 10:06:23.063727 30962 ts_tablet_manager.cc:1397] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:06:23.063817 30963 tablet_bootstrap.cc:654] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:23.064160 30963 log.cc:824] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:23.065104 30963 tablet_bootstrap.cc:492] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce: No bootstrap required, opened a new log
I20260811 10:06:23.065172 30963 ts_tablet_manager.cc:1397] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:06:23.065172 30966 tablet_bootstrap.cc:492] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e: Bootstrap starting.
I20260811 10:06:23.065826 30966 tablet_bootstrap.cc:654] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:23.066188 30966 log.cc:824] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:23.066193 30962 raft_consensus.cc:348] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.066428 30962 raft_consensus.cc:374] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:23.066479 30962 raft_consensus.cc:729] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e531442910034c2ba2751f21ba4b3278, State: Initialized, Role: FOLLOWER
I20260811 10:06:23.066609 30962 consensus_queue.cc:260] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.066928 30962 ts_tablet_manager.cc:1428] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:06:23.066983 30946 heartbeater.cc:503] Master 127.9.127.254:34975 was elected leader, sending a full tablet report...
I20260811 10:06:23.067019 30966 tablet_bootstrap.cc:492] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e: No bootstrap required, opened a new log
I20260811 10:06:23.067081 30966 ts_tablet_manager.cc:1397] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:06:23.067719 30963 raft_consensus.cc:348] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.067865 30963 raft_consensus.cc:374] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:23.067909 30963 raft_consensus.cc:729] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbda212f121049088d5289f2ccc3dcce, State: Initialized, Role: FOLLOWER
I20260811 10:06:23.068044 30963 consensus_queue.cc:260] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.068311 30963 ts_tablet_manager.cc:1428] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 10:06:23.068436 30653 heartbeater.cc:503] Master 127.9.127.254:34975 was elected leader, sending a full tablet report...
I20260811 10:06:23.069572 30966 raft_consensus.cc:348] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.069694 30966 raft_consensus.cc:374] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:23.069716 30966 raft_consensus.cc:729] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874b73d57ed2431aa29c9c64ce09448e, State: Initialized, Role: FOLLOWER
I20260811 10:06:23.069820 30966 consensus_queue.cc:260] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.070037 30966 ts_tablet_manager.cc:1428] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 10:06:23.070132 30801 heartbeater.cc:503] Master 127.9.127.254:34975 was elected leader, sending a full tablet report...
I20260811 10:06:23.078161 30969 raft_consensus.cc:482] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:23.078236 30969 raft_consensus.cc:504] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.078608 30969 leader_election.cc:288] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 874b73d57ed2431aa29c9c64ce09448e (127.9.127.194:40581), e531442910034c2ba2751f21ba4b3278 (127.9.127.195:43593)
I20260811 10:06:23.081488 30961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.078870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:47779 (local address 127.9.127.194:40581)
0811 10:06:23.078927 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:23.078930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:23.078939 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:06:23.079007 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:23.079008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:23.079017 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:23.079069 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:23.079238 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.079715 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.080691 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.081124 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.081208 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.081216 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:23.081374 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 10:06:23.081414 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:06:23.081547 30960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.078937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:39435 (local address 127.9.127.195:43593)
0811 10:06:23.079001 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:23.079003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:23.079068 (+ 65us) server_negotiation.cc:407] Connection header received
0811 10:06:23.079134 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:23.079134 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:23.079143 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:23.079230 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:23.079380 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.079829 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.080819 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.081179 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.081265 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.081273 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:23.081437 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 10:06:23.081473 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:06:23.081571 30972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.078774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:43593 (local address 127.9.127.193:39435)
0811 10:06:23.079018 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:23.079027 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:23.079084 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:23.079233 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:23.079234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:23.079236 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:23.079303 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.079305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.079931 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.079932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.080694 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.080696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.081267 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.081268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.081342 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.081346 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:23.081429 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 10:06:23.081467 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":21,"thread_start_us":103,"threads_started":1}
I20260811 10:06:23.081475 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.078774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:40581 (local address 127.9.127.193:47779)
0811 10:06:23.078835 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:23.078858 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:23.078943 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:23.079077 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:23.079078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:23.079079 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:23.079142 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.079143 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.079799 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.079800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.080584 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:23.080587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.081207 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.081208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:23.081279 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.081283 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:23.081365 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 10:06:23.081407 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":22}
I20260811 10:06:23.081900 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c01376aaa9b5438fa21106bba4328333" candidate_uuid: "cbda212f121049088d5289f2ccc3dcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e531442910034c2ba2751f21ba4b3278" is_pre_election: true
I20260811 10:06:23.082050 30892 raft_consensus.cc:2454] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbda212f121049088d5289f2ccc3dcce in term 0.
I20260811 10:06:23.082125 30750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c01376aaa9b5438fa21106bba4328333" candidate_uuid: "cbda212f121049088d5289f2ccc3dcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874b73d57ed2431aa29c9c64ce09448e" is_pre_election: true
I20260811 10:06:23.082283 30750 raft_consensus.cc:2454] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbda212f121049088d5289f2ccc3dcce in term 0.
I20260811 10:06:23.082297 30530 leader_election.cc:302] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbda212f121049088d5289f2ccc3dcce, e531442910034c2ba2751f21ba4b3278; no voters:
I20260811 10:06:23.082427 30969 raft_consensus.cc:2781] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:06:23.082494 30969 raft_consensus.cc:482] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:06:23.082526 30969 raft_consensus.cc:3037] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:23.083177 30969 raft_consensus.cc:504] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.083334 30969 leader_election.cc:288] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [CANDIDATE]: Term 1 election: Requested vote from peers 874b73d57ed2431aa29c9c64ce09448e (127.9.127.194:40581), e531442910034c2ba2751f21ba4b3278 (127.9.127.195:43593)
I20260811 10:06:23.083464 30750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c01376aaa9b5438fa21106bba4328333" candidate_uuid: "cbda212f121049088d5289f2ccc3dcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874b73d57ed2431aa29c9c64ce09448e"
I20260811 10:06:23.083478 30892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c01376aaa9b5438fa21106bba4328333" candidate_uuid: "cbda212f121049088d5289f2ccc3dcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e531442910034c2ba2751f21ba4b3278"
I20260811 10:06:23.083549 30892 raft_consensus.cc:3037] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:23.083536 30750 raft_consensus.cc:3037] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:23.084240 30750 raft_consensus.cc:2454] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbda212f121049088d5289f2ccc3dcce in term 1.
I20260811 10:06:23.084297 30892 raft_consensus.cc:2454] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbda212f121049088d5289f2ccc3dcce in term 1.
I20260811 10:06:23.084450 30529 leader_election.cc:302] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 874b73d57ed2431aa29c9c64ce09448e, cbda212f121049088d5289f2ccc3dcce; no voters:
I20260811 10:06:23.084547 30969 raft_consensus.cc:2781] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:23.084712 30969 raft_consensus.cc:686] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 1 LEADER]: Becoming Leader. State: Replica: cbda212f121049088d5289f2ccc3dcce, State: Running, Role: LEADER
I20260811 10:06:23.084856 30969 consensus_queue.cc:237] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } }
I20260811 10:06:23.085625 30451 catalog_manager.cc:5495] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce reported cstate change: term changed from 0 to 1, leader changed from <none> to cbda212f121049088d5289f2ccc3dcce (127.9.127.193). New cstate: current_term: 1 leader_uuid: "cbda212f121049088d5289f2ccc3dcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbda212f121049088d5289f2ccc3dcce" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 36451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 } health_report { overall_health: UNKNOWN } } }
I20260811 10:06:23.092180 30959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.090107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49234 (local address 127.9.127.193:36451)
0811 10:06:23.090164 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:23.090166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:23.090174 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:06:23.090202 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:23.090203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:23.090217 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:23.090274 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:23.090397 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.090814 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.091475 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:23.091643 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:23.091689 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:23.091817 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:23.091890 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:23.091986 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:23.092077 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 10:06:23.092087 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:06:23.094029 30750 raft_consensus.cc:1261] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 1 FOLLOWER]: Refusing update from remote peer cbda212f121049088d5289f2ccc3dcce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:23.094053 30892 raft_consensus.cc:1261] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 1 FOLLOWER]: Refusing update from remote peer cbda212f121049088d5289f2ccc3dcce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:23.094415 30973 consensus_queue.cc:1035] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "874b73d57ed2431aa29c9c64ce09448e" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 40581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:23.094578 30969 consensus_queue.cc:1035] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "e531442910034c2ba2751f21ba4b3278" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:23.096886 30976 mvcc.cc:205] Tried to move back new op lower bound from 7317269639550291968 to 7317269639516209152. Current Snapshot: MvccSnapshot[applied={T|T < 7317269639550291968}]
I20260811 10:06:23.097114 30978 mvcc.cc:205] Tried to move back new op lower bound from 7317269639550291968 to 7317269639516209152. Current Snapshot: MvccSnapshot[applied={T|T < 7317269639550291968}]
I20260811 10:06:23.097446 30977 mvcc.cc:205] Tried to move back new op lower bound from 7317269639550291968 to 7317269639516209152. Current Snapshot: MvccSnapshot[applied={T|T < 7317269639550291968}]
I20260811 10:06:23.099828 30451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:23.099915 30451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:23.100672 30451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2bc56656b7e4488eb7d222c2bfa3188b: Sending DeleteTablet for 3 replicas of tablet c01376aaa9b5438fa21106bba4328333
I20260811 10:06:23.101058 30583 tablet_service.cc:1514] Processing DeleteTablet for tablet c01376aaa9b5438fa21106bba4328333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:23 UTC) from {username='slave'} at 127.0.0.1:49220
I20260811 10:06:23.101065 30729 tablet_service.cc:1514] Processing DeleteTablet for tablet c01376aaa9b5438fa21106bba4328333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:23 UTC) from {username='slave'} at 127.0.0.1:53158
I20260811 10:06:23.101315 30987 tablet_replica.cc:330] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce: stopping tablet replica
I20260811 10:06:23.101368 30871 tablet_service.cc:1514] Processing DeleteTablet for tablet c01376aaa9b5438fa21106bba4328333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:23 UTC) from {username='slave'} at 127.0.0.1:46306
I20260811 10:06:23.101423 30987 raft_consensus.cc:2229] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:06:23.101565 30987 raft_consensus.cc:2258] T c01376aaa9b5438fa21106bba4328333 P cbda212f121049088d5289f2ccc3dcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:23.101575 30989 tablet_replica.cc:330] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: stopping tablet replica
I20260811 10:06:23.101766 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 30513
I20260811 10:06:23.104395 30989 raft_consensus.cc:2229] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:23.104544 30989 raft_consensus.cc:2258] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:23.105002 30989 ts_tablet_manager.cc:1905] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:23.106508 30989 ts_tablet_manager.cc:1918] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:23.106600 30989 log.cc:1196] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/c01376aaa9b5438fa21106bba4328333
I20260811 10:06:23.106897 30989 ts_tablet_manager.cc:1939] T c01376aaa9b5438fa21106bba4328333 P e531442910034c2ba2751f21ba4b3278: Deleting consensus metadata
I20260811 10:06:23.107371 30432 catalog_manager.cc:4841] TS e531442910034c2ba2751f21ba4b3278 (127.9.127.195:43593): tablet c01376aaa9b5438fa21106bba4328333 (table test-table [id=1060c6f636034d31a2a87898eacdef07]) successfully deleted
I20260811 10:06:23.112926 30988 tablet_replica.cc:330] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e: stopping tablet replica
I20260811 10:06:23.113090 30988 raft_consensus.cc:2229] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:23.113245 30988 raft_consensus.cc:2258] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:23.113683 30988 ts_tablet_manager.cc:1905] T c01376aaa9b5438fa21106bba4328333 P 874b73d57ed2431aa29c9c64ce09448e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 10:06:23.114079 30433 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:36451 (error 108)
I20260811 10:06:23.114279 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 30656
I20260811 10:06:23.117782 30956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.117653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:36451 (local address 127.0.0.1:49244)
0811 10:06:23.117693 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:23.117741 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:36451: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260811 10:06:23.117960 30433 catalog_manager.cc:4584] TS cbda212f121049088d5289f2ccc3dcce (127.9.127.193:36451): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c01376aaa9b5438fa21106bba4328333: Network error: Client connection negotiation failed: client connection to 127.9.127.193:36451: connect: Connection refused (error 111)
I20260811 10:06:23.121831 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 30805
I20260811 10:06:23.121863 30956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:23.121751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:40581 (local address 127.0.0.1:53164)
0811 10:06:23.121806 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:23.121831 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.194:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 10:06:23.128849 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 30413
2026-08-11T10:06:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (661 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:23 dist-test-slave-1x4g krb5kdc[30993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:23 dist-test-slave-1x4g krb5kdc[30993](info): set up 2 sockets
Aug 11 10:06:23 dist-test-slave-1x4g krb5kdc[30993](info): commencing operation
krb5kdc: starting...
W20260811 10:06:24.510560 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.360s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:24 dist-test-slave-1x4g krb5kdc[30993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:24.631860 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:39261
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:39261
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:24.711153 31008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:24.711369 31008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:24.711406 31008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:24.712584 31008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:24.712651 31008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:24.712674 31008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:24.712702 31008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:24.712735 31008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:24.714187 31008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:39261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:39261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:24.714434 31008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:24.714665 31008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:24.719241 31013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:24.719271 31014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:24.719246 31016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:24.719491 31008 server_base.cc:1034] running on GCE node
I20260811 10:06:24.719760 31008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:24.719996 31008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:24.721155 31008 hybrid_clock.cc:648] HybridClock initialized: now 1786442784721146 us; error 39 us; skew 500 ppm
Aug 11 10:06:24 dist-test-slave-1x4g krb5kdc[30993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442784, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:24.723515 31008 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:24.723944 31008 webserver.cc:460] Webserver started at http://127.9.127.254:39691/ using document root <none> and password file <none>
I20260811 10:06:24.724174 31008 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:24.724247 31008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:24.724395 31008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:24.725526 31008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "38c6868682fa4498aed59310eb0527c9"
format_stamp: "Formatted at 2026-08-11 10:06:24 on dist-test-slave-1x4g"
server_key: "e8b6382138a9f9112d4a9344c362f26a"
server_key_iv: "9d8c54b32044b780651dd5718337c8f3"
server_key_version: "encryptionkey@0"
I20260811 10:06:24.725890 31008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "38c6868682fa4498aed59310eb0527c9"
format_stamp: "Formatted at 2026-08-11 10:06:24 on dist-test-slave-1x4g"
server_key: "e8b6382138a9f9112d4a9344c362f26a"
server_key_iv: "9d8c54b32044b780651dd5718337c8f3"
server_key_version: "encryptionkey@0"
I20260811 10:06:24.727183 31008 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:24.727873 31025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:24.728042 31008 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:24.728152 31008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "38c6868682fa4498aed59310eb0527c9"
format_stamp: "Formatted at 2026-08-11 10:06:24 on dist-test-slave-1x4g"
server_key: "e8b6382138a9f9112d4a9344c362f26a"
server_key_iv: "9d8c54b32044b780651dd5718337c8f3"
server_key_version: "encryptionkey@0"
I20260811 10:06:24.728227 31008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:24.742751 31008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:24.744983 31008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:24.745132 31008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:24.749245 31008 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:39261
I20260811 10:06:24.749277 31086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:39261 every 8 connection(s)
I20260811 10:06:24.749616 31008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:24.750428 31087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:24.752600 31087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9: Bootstrap starting.
I20260811 10:06:24.753214 31087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:24.753538 31087 log.cc:824] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:24.754266 31087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9: No bootstrap required, opened a new log
I20260811 10:06:24.755903 31087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c6868682fa4498aed59310eb0527c9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39261 } }
I20260811 10:06:24.756031 31087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:24.756074 31087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c6868682fa4498aed59310eb0527c9, State: Initialized, Role: FOLLOWER
I20260811 10:06:24.756215 31087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c6868682fa4498aed59310eb0527c9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39261 } }
I20260811 10:06:24.756292 31087 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:24.756313 31087 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:24.756368 31087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:24.757010 31087 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c6868682fa4498aed59310eb0527c9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39261 } }
I20260811 10:06:24.757028 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 31008
I20260811 10:06:24.757099 31087 leader_election.cc:302] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38c6868682fa4498aed59310eb0527c9; no voters:
I20260811 10:06:24.757160 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:24.757308 31087 leader_election.cc:288] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:24.757347 31090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:24.757382 9727 external_mini_cluster.cc:1428] Setting key c29c120b1283d33b0760b96ee948d840
I20260811 10:06:24.757469 31090 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [term 1 LEADER]: Becoming Leader. State: Replica: 38c6868682fa4498aed59310eb0527c9, State: Running, Role: LEADER
I20260811 10:06:24.757553 31090 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c6868682fa4498aed59310eb0527c9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39261 } }
I20260811 10:06:24.757582 31087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:24.757885 31090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38c6868682fa4498aed59310eb0527c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c6868682fa4498aed59310eb0527c9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39261 } } }
I20260811 10:06:24.757949 31090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:24.758363 31091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c6868682fa4498aed59310eb0527c9. Latest consensus state: current_term: 1 leader_uuid: "38c6868682fa4498aed59310eb0527c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c6868682fa4498aed59310eb0527c9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 39261 } } }
I20260811 10:06:24.758450 31091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:24.759105 31097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:24.759671 31097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:24.761387 31097 catalog_manager.cc:1347] Generated new cluster ID: 57f724d50576456cab7dda9a59ce4c4f
I20260811 10:06:24.761440 31097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:06:24 dist-test-slave-1x4g krb5kdc[30993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:24.768999 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:24.758092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.9.127.254:39261)
0811 10:06:24.758443 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:24.758453 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:24.758486 (+ 33us) server_negotiation.cc:407] Connection header received
0811 10:06:24.758609 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:24.758616 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:24.758670 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:24.759636 (+ 966us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:24.759734 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:24.760973 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:24.761975 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:24.762567 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:24.762683 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:24.765456 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:24.765460 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:24.765461 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:24.765473 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:24.767362 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:24.767772 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:24.767774 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:24.767775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:24.767888 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:24.768119 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:24.768120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:24.768120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:24.768414 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:24.768554 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:24.768672 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 10:06:24.768807 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":71,"threads_started":1}
I20260811 10:06:24.771552 31097 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:24.772050 31097 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:24.774328 31097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9: Generated new TSK 0
I20260811 10:06:24.774493 31097 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.9.127.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
Entry for principal kudu/127.9.127.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab.
I20260811 10:06:24.809790 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39261
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:24.893563 31116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:24.893771 31116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:24.893795 31116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:24.894914 31116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:24.894955 31116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:24.894981 31116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:06:24.896473 31116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.193.keytab
--principal=kudu/127.9.127.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:24.896742 31116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:24.897033 31116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:24.902032 31124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:24.902179 31116 server_base.cc:1034] running on GCE node
W20260811 10:06:24.902057 31121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:24.902042 31122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:24.902456 31116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:24.902707 31116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:24.903888 31116 hybrid_clock.cc:648] HybridClock initialized: now 1786442784903882 us; error 37 us; skew 500 ppm
Aug 11 10:06:24 dist-test-slave-1x4g krb5kdc[30993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442784, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:24.906672 31116 init.cc:377] Logged in from keytab as kudu/127.9.127.193@KRBTEST.COM (short username kudu)
I20260811 10:06:24.907135 31116 webserver.cc:460] Webserver started at http://127.9.127.193:41517/ using document root <none> and password file <none>
I20260811 10:06:24.907334 31116 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:24.907373 31116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:24.907471 31116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:24.908427 31116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "73bc2080fc9c4e48b3c1cb6b4500af58"
format_stamp: "Formatted at 2026-08-11 10:06:24 on dist-test-slave-1x4g"
server_key: "46deb52e3cc48080d5584fdff31b5b60"
server_key_iv: "f1a6328aba402f616399e28a8e318e66"
server_key_version: "encryptionkey@0"
I20260811 10:06:24.908741 31116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "73bc2080fc9c4e48b3c1cb6b4500af58"
format_stamp: "Formatted at 2026-08-11 10:06:24 on dist-test-slave-1x4g"
server_key: "46deb52e3cc48080d5584fdff31b5b60"
server_key_iv: "f1a6328aba402f616399e28a8e318e66"
server_key_version: "encryptionkey@0"
I20260811 10:06:24.910073 31116 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:06:24.910782 31131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:24.910974 31116 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:24.911060 31116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "73bc2080fc9c4e48b3c1cb6b4500af58"
format_stamp: "Formatted at 2026-08-11 10:06:24 on dist-test-slave-1x4g"
server_key: "46deb52e3cc48080d5584fdff31b5b60"
server_key_iv: "f1a6328aba402f616399e28a8e318e66"
server_key_version: "encryptionkey@0"
I20260811 10:06:24.911120 31116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:24.924635 31116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:24.926576 31116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:24.926685 31116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:24.926854 31116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:24.927171 31116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:24.927205 31116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:24.927225 31116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:24.927273 31116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:24.933306 31116 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:40625
I20260811 10:06:24.933387 31260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:40625 every 8 connection(s)
I20260811 10:06:24.933684 31116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:06:24.935089 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 31116
I20260811 10:06:24.935225 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:06:24.935411 9727 external_mini_cluster.cc:1428] Setting key 6cf49f0416eeaaaaff7265f5d931714a
Aug 11 10:06:24 dist-test-slave-1x4g krb5kdc[30993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442784, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.193@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:24.943689 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:24.934358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:45631 (local address 127.9.127.254:39261)
0811 10:06:24.934418 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:24.934420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:24.934620 (+ 200us) server_negotiation.cc:407] Connection header received
0811 10:06:24.935146 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:24.935148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:24.935164 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:24.935210 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:24.936399 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:24.937014 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:24.938185 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:24.938388 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:24.938441 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:24.940866 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:24.940868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:24.940868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:24.940881 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:24.942265 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:24.942712 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:24.942713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:24.942713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:24.942777 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:24.943045 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:24.943046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:24.943046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:24.943169 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:24.943241 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:24.943511 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 10:06:24.943599 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 10:06:24.943922 31264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:24.934330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39261 (local address 127.9.127.193:45631)
0811 10:06:24.934511 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:24.934545 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:24.935031 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:24.935290 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:24.935296 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:24.936025 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:24.936306 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:24.936311 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:24.937112 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:24.937114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:24.938070 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:24.938074 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:24.938469 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:24.938470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:24.938649 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:24.939149 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:24.939159 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:24.940722 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:24.942390 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:24.942398 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:24.942400 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:24.942633 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:24.942858 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:24.942859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:24.942859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:24.942980 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:24.943245 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:24.943252 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:24.943385 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 10:06:24.943487 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 10:06:24.943653 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
WARNING: no policy specified for kudu/127.9.127.194@KRBTEST.COM; defaulting to no policy
I20260811 10:06:24.944435 31261 heartbeater.cc:347] Connected to a master server at 127.9.127.254:39261
I20260811 10:06:24.944540 31261 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:24.944741 31261 heartbeater.cc:511] Master 127.9.127.254:39261 requested a full tablet report, sending...
I20260811 10:06:24.945288 31044 ts_manager.cc:194] Registered new tserver with Master: 73bc2080fc9c4e48b3c1cb6b4500af58 (127.9.127.193:40625)
I20260811 10:06:24.946007 31044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.193@KRBTEST.COM'} at 127.9.127.193:45631
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
Entry for principal kudu/127.9.127.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab.
I20260811 10:06:24.961977 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39261
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:25.044884 31267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:25.045068 31267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:25.045090 31267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:25.046207 31267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:25.046247 31267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:25.046276 31267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:06:25.047655 31267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.194.keytab
--principal=kudu/127.9.127.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:25.047832 31267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:25.047998 31267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:25.052810 31275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:25.052809 31273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:25.052903 31272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:25.053022 31267 server_base.cc:1034] running on GCE node
I20260811 10:06:25.053197 31267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:25.053378 31267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:25.054512 31267 hybrid_clock.cc:648] HybridClock initialized: now 1786442785054504 us; error 32 us; skew 500 ppm
Aug 11 10:06:25 dist-test-slave-1x4g krb5kdc[30993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442785, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:25.057050 31267 init.cc:377] Logged in from keytab as kudu/127.9.127.194@KRBTEST.COM (short username kudu)
I20260811 10:06:25.057511 31267 webserver.cc:460] Webserver started at http://127.9.127.194:34213/ using document root <none> and password file <none>
I20260811 10:06:25.057749 31267 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:25.057816 31267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:25.057960 31267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:25.059013 31267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "31c78de2e62d4e1a909f57abdf3d32f1"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "10872101b980f2dd4d253dcc459d2205"
server_key_iv: "e038d869e2323c52b806c283643ca4c9"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.059401 31267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "31c78de2e62d4e1a909f57abdf3d32f1"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "10872101b980f2dd4d253dcc459d2205"
server_key_iv: "e038d869e2323c52b806c283643ca4c9"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.060715 31267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:25.061511 31283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.061687 31267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 10:06:25.061779 31267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "31c78de2e62d4e1a909f57abdf3d32f1"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "10872101b980f2dd4d253dcc459d2205"
server_key_iv: "e038d869e2323c52b806c283643ca4c9"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.061856 31267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:25.073976 31267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:25.075685 31267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:25.075840 31267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:25.076061 31267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:25.076354 31267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:25.076406 31267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.076442 31267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:25.076467 31267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.082397 31267 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:39231
I20260811 10:06:25.082512 31410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:39231 every 8 connection(s)
I20260811 10:06:25.082790 31267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:06:25.087086 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 31267
I20260811 10:06:25.087209 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:06:25.087419 9727 external_mini_cluster.cc:1428] Setting key 3aad0b2b93aad8f7670f17e66fb7082f
Aug 11 10:06:25 dist-test-slave-1x4g krb5kdc[30993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442785, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.194@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:25.092417 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.083566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:35407 (local address 127.9.127.254:39261)
0811 10:06:25.083640 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.083642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.083824 (+ 182us) server_negotiation.cc:407] Connection header received
0811 10:06:25.084326 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.084327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.084341 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.084403 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:25.085323 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.085863 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.086868 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.087235 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.087310 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.089535 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:25.089536 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:25.089537 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:25.089544 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:25.091035 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:25.091498 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:25.091499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:25.091499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:25.091549 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:25.091816 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:25.091816 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:25.091817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:25.091914 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:25.091963 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.092283 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.092355 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 10:06:25.092723 31413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.083540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39261 (local address 127.9.127.194:35407)
0811 10:06:25.083701 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.083743 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:25.084221 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:25.084471 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:25.084476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:25.085045 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:25.085229 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.085233 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.085965 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.085966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.086766 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.086769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.087323 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.087324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.087448 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.088036 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:25.088044 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:25.089445 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:25.091117 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:25.091124 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:25.091126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:25.091427 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:25.091613 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:25.091614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:25.091615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:25.091755 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:25.091990 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:25.091997 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:25.092154 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 10:06:25.092263 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 10:06:25.092445 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260811 10:06:25.093345 31411 heartbeater.cc:347] Connected to a master server at 127.9.127.254:39261
I20260811 10:06:25.093456 31411 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:25.093636 31411 heartbeater.cc:511] Master 127.9.127.254:39261 requested a full tablet report, sending...
I20260811 10:06:25.094025 31044 ts_manager.cc:194] Registered new tserver with Master: 31c78de2e62d4e1a909f57abdf3d32f1 (127.9.127.194:39231)
I20260811 10:06:25.094394 31044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.194@KRBTEST.COM'} at 127.9.127.194:35407
WARNING: no policy specified for kudu/127.9.127.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
Entry for principal kudu/127.9.127.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab.
I20260811 10:06:25.114097 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39261
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:25.195747 31416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:25.195940 31416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:25.195961 31416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:25.197098 31416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:25.197136 31416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:25.197161 31416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:06:25.198561 31416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.195.keytab
--principal=kudu/127.9.127.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:39261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:25.198807 31416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:25.199002 31416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:25.203913 31422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:25.203915 31421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:25.203914 31425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:25.203931 31416 server_base.cc:1034] running on GCE node
I20260811 10:06:25.204376 31416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:25.204613 31416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:25.205783 31416 hybrid_clock.cc:648] HybridClock initialized: now 1786442785205771 us; error 30 us; skew 500 ppm
Aug 11 10:06:25 dist-test-slave-1x4g krb5kdc[30993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442785, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:25.208210 31416 init.cc:377] Logged in from keytab as kudu/127.9.127.195@KRBTEST.COM (short username kudu)
I20260811 10:06:25.208669 31416 webserver.cc:460] Webserver started at http://127.9.127.195:39903/ using document root <none> and password file <none>
I20260811 10:06:25.208910 31416 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:25.208976 31416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:25.209116 31416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:25.210170 31416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "9a8ecca005894880a0fe5d58b74fe2d7"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "7c68a3de8a8079e462ad781e52596ce3"
server_key_iv: "7441fa6e8308e081457c136983168e09"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.210541 31416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "9a8ecca005894880a0fe5d58b74fe2d7"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "7c68a3de8a8079e462ad781e52596ce3"
server_key_iv: "7441fa6e8308e081457c136983168e09"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.211961 31416 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:25.212703 31433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.212881 31416 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:25.212992 31416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "9a8ecca005894880a0fe5d58b74fe2d7"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "7c68a3de8a8079e462ad781e52596ce3"
server_key_iv: "7441fa6e8308e081457c136983168e09"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.213061 31416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:25.224992 31416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:25.226917 31416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:25.227033 31416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:25.227226 31416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:25.227543 31416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:25.227598 31416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.227632 31416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:25.227661 31416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.233884 31416 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:45183
I20260811 10:06:25.233932 31557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:45183 every 8 connection(s)
I20260811 10:06:25.234262 31416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:06:25.239327 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 31416
I20260811 10:06:25.239423 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:06:25.239658 9727 external_mini_cluster.cc:1428] Setting key 564289f4a0aa53ce48875234787346c9
Aug 11 10:06:25 dist-test-slave-1x4g krb5kdc[30993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442785, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.195@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:25.243403 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.234971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:58725 (local address 127.9.127.254:39261)
0811 10:06:25.235046 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.235048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.235236 (+ 188us) server_negotiation.cc:407] Connection header received
0811 10:06:25.235741 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.235742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.235752 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.235804 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:25.236713 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.237278 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.238240 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.238414 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.238463 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.240997 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:25.240999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:25.240999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:25.241007 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:25.242243 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:25.242621 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:25.242622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:25.242622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:25.242673 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:25.242878 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:25.242878 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:25.242879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:25.243005 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:25.243054 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.243285 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.243345 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 10:06:25.243559 31560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.234932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:39261 (local address 127.9.127.195:58725)
0811 10:06:25.235099 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.235134 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:25.235655 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:25.235856 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:25.235859 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:25.236413 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:25.236612 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.236617 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.237357 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.237358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.238161 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.238163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.238493 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.238494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.238589 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.239127 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:25.239136 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:25.240911 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:25.242316 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:25.242323 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:25.242324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:25.242557 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:25.242730 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:25.242731 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:25.242731 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:25.242826 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:25.243059 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:25.243063 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:25.243183 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 10:06:25.243257 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 10:06:25.243364 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
I20260811 10:06:25.244014 31558 heartbeater.cc:347] Connected to a master server at 127.9.127.254:39261
I20260811 10:06:25.244133 31558 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:25.244331 31558 heartbeater.cc:511] Master 127.9.127.254:39261 requested a full tablet report, sending...
I20260811 10:06:25.244714 31044 ts_manager.cc:194] Registered new tserver with Master: 9a8ecca005894880a0fe5d58b74fe2d7 (127.9.127.195:45183)
I20260811 10:06:25.245087 31044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.9.127.195@KRBTEST.COM'} at 127.9.127.195:58725
I20260811 10:06:25.252593 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:06:25.260754 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.254408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43034 (local address 127.9.127.254:39261)
0811 10:06:25.254493 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.254495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.254581 (+ 86us) server_negotiation.cc:407] Connection header received
0811 10:06:25.254659 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.254660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.254676 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.254740 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:25.255333 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.255805 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.256555 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.256752 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.256886 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.258205 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:25.258207 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:25.258207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:25.258215 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:25.259565 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:25.259917 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:25.259918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:25.259918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:25.259967 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:25.260185 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:25.260186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:25.260186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:25.260326 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:25.260435 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.260566 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.260645 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 10:06:25.262372 31044 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43034:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:06:25.263859 31044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:06:25.269984 31571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.265863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39231 (local address 127.0.0.1:55262)
0811 10:06:25.266345 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.266355 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:25.266412 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:25.266688 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:25.266689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:25.266691 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:25.266724 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.266726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.268010 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.268011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.268925 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.268963 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.269702 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.269703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.269759 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.269767 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 10:06:25.269849 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 10:06:25.269913 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":2,"thread_start_us":58,"threads_started":1}
I20260811 10:06:25.270004 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.265966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55262 (local address 127.9.127.194:39231)
0811 10:06:25.266195 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.266199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.266405 (+ 206us) server_negotiation.cc:407] Connection header received
0811 10:06:25.266517 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.266520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.266536 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.266608 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:25.266807 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.267896 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.269062 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.269577 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.269615 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.269652 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.269869 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.269918 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":101,"threads_started":1}
I20260811 10:06:25.270196 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.265842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:45183 (local address 127.0.0.1:53198)
0811 10:06:25.265970 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.266017 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:25.266081 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:25.266529 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:25.266532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:25.266534 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:25.266603 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.266605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.267956 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.267958 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.269075 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.269078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.269961 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.269962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.270038 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.270042 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:25.270073 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 10:06:25.270122 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":31,"thread_start_us":48,"threads_started":1}
I20260811 10:06:25.270380 31572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.266178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54158 (local address 127.9.127.193:40625)
0811 10:06:25.266320 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.266324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.266512 (+ 188us) server_negotiation.cc:407] Connection header received
0811 10:06:25.266560 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.266563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.266578 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.266665 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:25.266894 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.267609 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.269120 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.269844 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.269930 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.269985 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.270236 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.270287 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":80,"threads_started":1}
I20260811 10:06:25.270495 31566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.266037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:40625 (local address 127.0.0.1:54158)
0811 10:06:25.266371 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.266381 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:25.266436 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:25.266754 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:25.266755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:25.266757 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:25.266814 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.266816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.267719 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.267720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.269020 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.269023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.270028 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.270029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.270085 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.270088 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:25.270130 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 10:06:25.270162 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":56,"threads_started":1}
I20260811 10:06:25.270608 31573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.266179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53198 (local address 127.9.127.195:45183)
0811 10:06:25.266355 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.266360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.266371 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:06:25.266414 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.266416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.266432 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.266511 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:25.266690 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.267840 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.269162 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.269844 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.270368 (+ 524us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.270435 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.270463 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.270514 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
I20260811 10:06:25.270920 31335 tablet_service.cc:1467] Processing CreateTablet for tablet 658e3e7f0ec249e0bc076a767513ddef (DEFAULT_TABLE table=test-table [id=2ef835268fab435cae6e27bedf27e847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:25.271140 31487 tablet_service.cc:1467] Processing CreateTablet for tablet 658e3e7f0ec249e0bc076a767513ddef (DEFAULT_TABLE table=test-table [id=2ef835268fab435cae6e27bedf27e847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:25.271183 31189 tablet_service.cc:1467] Processing CreateTablet for tablet 658e3e7f0ec249e0bc076a767513ddef (DEFAULT_TABLE table=test-table [id=2ef835268fab435cae6e27bedf27e847]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:25.271292 31335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 658e3e7f0ec249e0bc076a767513ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:25.271378 31487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 658e3e7f0ec249e0bc076a767513ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:25.271484 31189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 658e3e7f0ec249e0bc076a767513ddef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:25.273949 31574 tablet_bootstrap.cc:492] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Bootstrap starting.
I20260811 10:06:25.274578 31576 tablet_bootstrap.cc:492] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Bootstrap starting.
I20260811 10:06:25.274833 31574 tablet_bootstrap.cc:654] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:25.275321 31576 tablet_bootstrap.cc:654] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:25.275462 31574 log.cc:824] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:25.275949 31576 log.cc:824] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:25.276299 31575 tablet_bootstrap.cc:492] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58: Bootstrap starting.
I20260811 10:06:25.276355 31574 tablet_bootstrap.cc:492] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: No bootstrap required, opened a new log
I20260811 10:06:25.276409 31574 ts_tablet_manager.cc:1397] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 10:06:25.276670 31576 tablet_bootstrap.cc:492] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: No bootstrap required, opened a new log
I20260811 10:06:25.276763 31576 ts_tablet_manager.cc:1397] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:06:25.277016 31575 tablet_bootstrap.cc:654] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:25.277598 31575 log.cc:824] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:25.278395 31575 tablet_bootstrap.cc:492] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58: No bootstrap required, opened a new log
I20260811 10:06:25.278469 31575 ts_tablet_manager.cc:1397] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 10:06:25.278426 31576 raft_consensus.cc:348] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.278661 31576 raft_consensus.cc:374] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:25.278574 31574 raft_consensus.cc:348] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.278704 31576 raft_consensus.cc:729] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31c78de2e62d4e1a909f57abdf3d32f1, State: Initialized, Role: FOLLOWER
I20260811 10:06:25.278725 31574 raft_consensus.cc:374] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:25.278766 31574 raft_consensus.cc:729] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a8ecca005894880a0fe5d58b74fe2d7, State: Initialized, Role: FOLLOWER
I20260811 10:06:25.278810 31576 consensus_queue.cc:260] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.278889 31574 consensus_queue.cc:260] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.279096 31576 ts_tablet_manager.cc:1428] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 10:06:25.279116 31411 heartbeater.cc:503] Master 127.9.127.254:39261 was elected leader, sending a full tablet report...
I20260811 10:06:25.279150 31574 ts_tablet_manager.cc:1428] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:06:25.279277 31558 heartbeater.cc:503] Master 127.9.127.254:39261 was elected leader, sending a full tablet report...
I20260811 10:06:25.280488 31575 raft_consensus.cc:348] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.280620 31575 raft_consensus.cc:374] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:25.280642 31575 raft_consensus.cc:729] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bc2080fc9c4e48b3c1cb6b4500af58, State: Initialized, Role: FOLLOWER
I20260811 10:06:25.280742 31575 consensus_queue.cc:260] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.280992 31575 ts_tablet_manager.cc:1428] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 10:06:25.281047 31261 heartbeater.cc:503] Master 127.9.127.254:39261 was elected leader, sending a full tablet report...
W20260811 10:06:25.333340 31412 tablet.cc:2369] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:06:25.434417 31262 tablet.cc:2369] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 10:06:25.484928 31559 tablet.cc:2369] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 10:06:25.506048 31583 raft_consensus.cc:482] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:25.506171 31583 raft_consensus.cc:504] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.506488 31583 leader_election.cc:288] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31c78de2e62d4e1a909f57abdf3d32f1 (127.9.127.194:39231), 73bc2080fc9c4e48b3c1cb6b4500af58 (127.9.127.193:40625)
I20260811 10:06:25.510461 31572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.506765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:45291 (local address 127.9.127.193:40625)
0811 10:06:25.506810 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.506812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.506964 (+ 152us) server_negotiation.cc:407] Connection header received
0811 10:06:25.507047 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.507048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.507056 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.507107 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:25.507271 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.507954 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.509460 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.510053 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.510135 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.510144 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.510350 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.510390 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:06:25.510461 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.506772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:48039 (local address 127.9.127.194:39231)
0811 10:06:25.506816 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.506818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.506827 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:06:25.506859 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.506860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.506876 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.506931 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:25.507170 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.507991 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.509455 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.510053 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.510135 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.510144 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.510351 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.510390 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 10:06:25.510483 31560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.506678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:39231 (local address 127.9.127.195:48039)
0811 10:06:25.506736 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.506748 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:25.506792 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:25.506961 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:25.506962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:25.506964 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:25.507074 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.507076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.508071 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.508071 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.509363 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.509367 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.510160 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.510161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.510264 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.510270 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 10:06:25.510329 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 10:06:25.510378 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":5}
I20260811 10:06:25.510481 31585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.506693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:40625 (local address 127.9.127.195:45291)
0811 10:06:25.506867 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.506875 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:25.506958 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:25.507129 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:25.507130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:25.507132 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:25.507199 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.507200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.508058 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.508059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.509363 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.509367 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.510160 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.510161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.510264 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.510270 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 10:06:25.510329 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 10:06:25.510377 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":82,"thread_start_us":116,"threads_started":1}
I20260811 10:06:25.510886 31359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "658e3e7f0ec249e0bc076a767513ddef" candidate_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" is_pre_election: true
I20260811 10:06:25.510949 31210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "658e3e7f0ec249e0bc076a767513ddef" candidate_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" is_pre_election: true
I20260811 10:06:25.511070 31359 raft_consensus.cc:2454] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a8ecca005894880a0fe5d58b74fe2d7 in term 0.
I20260811 10:06:25.511076 31210 raft_consensus.cc:2454] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a8ecca005894880a0fe5d58b74fe2d7 in term 0.
I20260811 10:06:25.511304 31438 leader_election.cc:302] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bc2080fc9c4e48b3c1cb6b4500af58, 9a8ecca005894880a0fe5d58b74fe2d7; no voters:
I20260811 10:06:25.511453 31583 raft_consensus.cc:2781] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:06:25.511530 31583 raft_consensus.cc:482] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:06:25.511566 31583 raft_consensus.cc:3037] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:25.512284 31583 raft_consensus.cc:504] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.512431 31583 leader_election.cc:288] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [CANDIDATE]: Term 1 election: Requested vote from peers 31c78de2e62d4e1a909f57abdf3d32f1 (127.9.127.194:39231), 73bc2080fc9c4e48b3c1cb6b4500af58 (127.9.127.193:40625)
I20260811 10:06:25.512609 31359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "658e3e7f0ec249e0bc076a767513ddef" candidate_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31c78de2e62d4e1a909f57abdf3d32f1"
I20260811 10:06:25.512598 31210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "658e3e7f0ec249e0bc076a767513ddef" candidate_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58"
I20260811 10:06:25.512712 31359 raft_consensus.cc:3037] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:25.512707 31210 raft_consensus.cc:3037] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:25.513527 31210 raft_consensus.cc:2454] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a8ecca005894880a0fe5d58b74fe2d7 in term 1.
I20260811 10:06:25.513609 31359 raft_consensus.cc:2454] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a8ecca005894880a0fe5d58b74fe2d7 in term 1.
I20260811 10:06:25.513737 31438 leader_election.cc:302] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bc2080fc9c4e48b3c1cb6b4500af58, 9a8ecca005894880a0fe5d58b74fe2d7; no voters:
I20260811 10:06:25.513830 31583 raft_consensus.cc:2781] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:25.514045 31583 raft_consensus.cc:686] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 1 LEADER]: Becoming Leader. State: Replica: 9a8ecca005894880a0fe5d58b74fe2d7, State: Running, Role: LEADER
I20260811 10:06:25.514146 31583 consensus_queue.cc:237] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } }
I20260811 10:06:25.515053 31042 catalog_manager.cc:5495] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a8ecca005894880a0fe5d58b74fe2d7 (127.9.127.195). New cstate: current_term: 1 leader_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a8ecca005894880a0fe5d58b74fe2d7" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 45183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 } health_report { overall_health: UNKNOWN } } }
I20260811 10:06:25.553702 31573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.551388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53212 (local address 127.9.127.195:45183)
0811 10:06:25.551453 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.551455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.551463 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:06:25.551501 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.551502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.551520 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.551603 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:25.551747 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.552206 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.552935 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.553166 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.553218 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.553367 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:25.553489 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:25.553545 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.553596 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.553612 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 10:06:25.555547 31210 raft_consensus.cc:1261] T 658e3e7f0ec249e0bc076a767513ddef P 73bc2080fc9c4e48b3c1cb6b4500af58 [term 1 FOLLOWER]: Refusing update from remote peer 9a8ecca005894880a0fe5d58b74fe2d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:25.555557 31359 raft_consensus.cc:1261] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 1 FOLLOWER]: Refusing update from remote peer 9a8ecca005894880a0fe5d58b74fe2d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:25.555935 31586 consensus_queue.cc:1035] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31c78de2e62d4e1a909f57abdf3d32f1" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 39231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:25.556056 31583 consensus_queue.cc:1035] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bc2080fc9c4e48b3c1cb6b4500af58" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 40625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:25.559157 31592 mvcc.cc:205] Tried to move back new op lower bound from 7317269649632714752 to 7317269649466621952. Current Snapshot: MvccSnapshot[applied={T|T < 7317269649632714752}]
I20260811 10:06:25.559603 31591 mvcc.cc:205] Tried to move back new op lower bound from 7317269649632714752 to 7317269649466621952. Current Snapshot: MvccSnapshot[applied={T|T < 7317269649632714752}]
I20260811 10:06:25.561070 31042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:25.561177 31042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43034:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:25.561885 31042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38c6868682fa4498aed59310eb0527c9: Sending DeleteTablet for 3 replicas of tablet 658e3e7f0ec249e0bc076a767513ddef
I20260811 10:06:25.562192 31487 tablet_service.cc:1514] Processing DeleteTablet for tablet 658e3e7f0ec249e0bc076a767513ddef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:25 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:53198
I20260811 10:06:25.562301 31335 tablet_service.cc:1514] Processing DeleteTablet for tablet 658e3e7f0ec249e0bc076a767513ddef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:25 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:55262
I20260811 10:06:25.562461 31189 tablet_service.cc:1514] Processing DeleteTablet for tablet 658e3e7f0ec249e0bc076a767513ddef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:25 UTC) from {username='kudu', principal='kudu/127.9.127.254@KRBTEST.COM'} at 127.0.0.1:54158
I20260811 10:06:25.562503 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 31116
I20260811 10:06:25.562621 31601 tablet_replica.cc:330] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: stopping tablet replica
I20260811 10:06:25.562732 31601 raft_consensus.cc:2229] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:06:25.562857 31601 raft_consensus.cc:2258] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:25.563033 31602 tablet_replica.cc:330] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: stopping tablet replica
I20260811 10:06:25.563117 31602 raft_consensus.cc:2229] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:25.563195 31602 raft_consensus.cc:2258] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:25.563931 31601 ts_tablet_manager.cc:1905] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:25.563997 31602 ts_tablet_manager.cc:1905] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:25.566007 31602 ts_tablet_manager.cc:1918] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:25.566018 31601 ts_tablet_manager.cc:1918] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:25.566098 31602 log.cc:1196] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/658e3e7f0ec249e0bc076a767513ddef
I20260811 10:06:25.566216 31601 log.cc:1196] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/658e3e7f0ec249e0bc076a767513ddef
I20260811 10:06:25.566372 31602 ts_tablet_manager.cc:1939] T 658e3e7f0ec249e0bc076a767513ddef P 31c78de2e62d4e1a909f57abdf3d32f1: Deleting consensus metadata
I20260811 10:06:25.566635 31601 ts_tablet_manager.cc:1939] T 658e3e7f0ec249e0bc076a767513ddef P 9a8ecca005894880a0fe5d58b74fe2d7: Deleting consensus metadata
I20260811 10:06:25.566816 31028 catalog_manager.cc:4841] TS 31c78de2e62d4e1a909f57abdf3d32f1 (127.9.127.194:39231): tablet 658e3e7f0ec249e0bc076a767513ddef (table test-table [id=2ef835268fab435cae6e27bedf27e847]) successfully deleted
I20260811 10:06:25.567152 31029 catalog_manager.cc:4841] TS 9a8ecca005894880a0fe5d58b74fe2d7 (127.9.127.195:45183): tablet 658e3e7f0ec249e0bc076a767513ddef (table test-table [id=2ef835268fab435cae6e27bedf27e847]) successfully deleted
W20260811 10:06:25.573444 31029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:40625 (error 108)
I20260811 10:06:25.573734 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 31267
I20260811 10:06:25.573988 31566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.573854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:40625 (local address 127.0.0.1:54168)
0811 10:06:25.573911 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.573945 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:40625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 10:06:25.574955 31029 catalog_manager.cc:4584] TS 73bc2080fc9c4e48b3c1cb6b4500af58 (127.9.127.193:40625): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 658e3e7f0ec249e0bc076a767513ddef: Network error: Client connection negotiation failed: client connection to 127.9.127.193:40625: connect: Connection refused (error 111)
I20260811 10:06:25.588551 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 31416
I20260811 10:06:25.593375 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 31008
2026-08-11T10:06:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2465 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T10:06:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:25Z Disabled control of system clock
I20260811 10:06:25.623816 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41527
--webserver_interface=127.9.127.254
--webserver_port=0
--builtin_ntp_servers=127.9.127.212:40729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:41527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:25.704409 31608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:25.704617 31608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:25.704638 31608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:25.705786 31608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:25.705827 31608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:25.705839 31608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:25.705852 31608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:25.705864 31608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:25.707099 31608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:41527
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:41527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:25.707280 31608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:25.707492 31608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:25.712280 31616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:25.712294 31613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:25.712381 31614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:25.712548 31608 server_base.cc:1034] running on GCE node
I20260811 10:06:25.712751 31608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:25.713507 31608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:25.714705 31608 hybrid_clock.cc:648] HybridClock initialized: now 1786442785714696 us; error 53 us; skew 500 ppm
I20260811 10:06:25.715946 31608 webserver.cc:460] Webserver started at http://127.9.127.254:39157/ using document root <none> and password file <none>
I20260811 10:06:25.716184 31608 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:25.716229 31608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:25.716377 31608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:25.717489 31608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "d5a0ae94d97a4f1aac15ecf1bb796469"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "887176c22ba18b6820580a80ffd8db9b"
server_key_iv: "cb332b858fde31405fab83bd663f15ba"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.717857 31608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "d5a0ae94d97a4f1aac15ecf1bb796469"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "887176c22ba18b6820580a80ffd8db9b"
server_key_iv: "cb332b858fde31405fab83bd663f15ba"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.719110 31608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 10:06:25.719848 31622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.720036 31608 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.720125 31608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "d5a0ae94d97a4f1aac15ecf1bb796469"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "887176c22ba18b6820580a80ffd8db9b"
server_key_iv: "cb332b858fde31405fab83bd663f15ba"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.720178 31608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:25.735831 31608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:25.736063 31608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:25.736166 31608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:25.740047 31608 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:41527
I20260811 10:06:25.740104 31677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:41527 every 8 connection(s)
I20260811 10:06:25.740432 31608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:25.741454 31678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:25.743673 31678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469: Bootstrap starting.
I20260811 10:06:25.744266 31678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:25.744562 31678 log.cc:824] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:25.745306 31678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469: No bootstrap required, opened a new log
I20260811 10:06:25.746958 31678 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a0ae94d97a4f1aac15ecf1bb796469" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41527 } }
I20260811 10:06:25.747119 31678 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:25.747167 31678 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5a0ae94d97a4f1aac15ecf1bb796469, State: Initialized, Role: FOLLOWER
I20260811 10:06:25.747313 31678 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a0ae94d97a4f1aac15ecf1bb796469" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41527 } }
I20260811 10:06:25.747375 31678 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:25.747396 31678 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:25.747465 31678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:25.747972 31678 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a0ae94d97a4f1aac15ecf1bb796469" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41527 } }
I20260811 10:06:25.748095 31678 leader_election.cc:302] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5a0ae94d97a4f1aac15ecf1bb796469; no voters:
I20260811 10:06:25.748294 31678 leader_election.cc:288] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:25.748381 31682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:25.748499 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 31608
I20260811 10:06:25.748551 31682 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [term 1 LEADER]: Becoming Leader. State: Replica: d5a0ae94d97a4f1aac15ecf1bb796469, State: Running, Role: LEADER
I20260811 10:06:25.748562 31678 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:25.748628 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:25.748695 31682 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a0ae94d97a4f1aac15ecf1bb796469" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41527 } }
I20260811 10:06:25.748883 9727 external_mini_cluster.cc:1428] Setting key a25b5ce8018ba1420a7220aad5f2f1b1
I20260811 10:06:25.749217 31683 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5a0ae94d97a4f1aac15ecf1bb796469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a0ae94d97a4f1aac15ecf1bb796469" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41527 } } }
I20260811 10:06:25.749352 31683 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:25.749570 31691 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:25.749871 31684 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5a0ae94d97a4f1aac15ecf1bb796469. Latest consensus state: current_term: 1 leader_uuid: "d5a0ae94d97a4f1aac15ecf1bb796469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5a0ae94d97a4f1aac15ecf1bb796469" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 41527 } } }
I20260811 10:06:25.749962 31684 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:25.750538 31691 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:25.752070 31691 catalog_manager.cc:1347] Generated new cluster ID: 5e0f95713640429aba9c6f0eab52e676
I20260811 10:06:25.752137 31691 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:25.755745 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.749813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35938 (local address 127.9.127.254:41527)
0811 10:06:25.750353 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.750362 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.750393 (+ 31us) server_negotiation.cc:407] Connection header received
0811 10:06:25.750506 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.750512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.750577 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.751053 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:25.751144 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.752475 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.753580 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.754214 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.754339 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.755046 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:25.755050 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:25.755051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:25.755260 (+ 209us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:25.755304 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:25.755318 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:25.755386 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.755456 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.755532 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":67,"threads_started":1}
I20260811 10:06:25.775959 31691 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:25.776495 31691 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:25.779726 31691 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469: Generated new TSK 0
I20260811 10:06:25.779894 31691 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:25.789191 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.193:0
--local_ip_for_outbound_sockets=127.9.127.193
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41527
--builtin_ntp_servers=127.9.127.212:40729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:25.874992 31707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:25.875227 31707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:25.875267 31707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:25.876410 31707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:25.876478 31707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:25.876520 31707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.193
I20260811 10:06:25.877983 31707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.127.193
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.193
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:25.878247 31707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:25.878548 31707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:25.883441 31715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:25.883460 31713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:25.883499 31712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:25.883636 31707 server_base.cc:1034] running on GCE node
I20260811 10:06:25.883947 31707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:25.884209 31707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:25.885367 31707 hybrid_clock.cc:648] HybridClock initialized: now 1786442785885354 us; error 42 us; skew 500 ppm
I20260811 10:06:25.886654 31707 webserver.cc:460] Webserver started at http://127.9.127.193:34031/ using document root <none> and password file <none>
I20260811 10:06:25.886895 31707 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:25.886967 31707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:25.887142 31707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:25.888206 31707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/data/instance:
uuid: "f08cc30b87d94573a6f01745fc142f3e"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "a3c072fdcb65922039e64500fd6994f1"
server_key_iv: "80f77b88fd3174466c453f5b85e3c341"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.888581 31707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance:
uuid: "f08cc30b87d94573a6f01745fc142f3e"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "a3c072fdcb65922039e64500fd6994f1"
server_key_iv: "80f77b88fd3174466c453f5b85e3c341"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.889938 31707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:25.890666 31721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.890822 31707 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:25.890918 31707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/wal
uuid: "f08cc30b87d94573a6f01745fc142f3e"
format_stamp: "Formatted at 2026-08-11 10:06:25 on dist-test-slave-1x4g"
server_key: "a3c072fdcb65922039e64500fd6994f1"
server_key_iv: "80f77b88fd3174466c453f5b85e3c341"
server_key_version: "encryptionkey@0"
I20260811 10:06:25.890997 31707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:25.919772 31707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:25.920104 31707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:25.920256 31707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:25.920502 31707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:25.920915 31707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:25.920969 31707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.921015 31707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:25.921063 31707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:25.926826 31707 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.193:44059
I20260811 10:06:25.926908 31849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.193:44059 every 8 connection(s)
I20260811 10:06:25.927253 31707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/data/info.pb
I20260811 10:06:25.932236 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.928065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:42185 (local address 127.9.127.254:41527)
0811 10:06:25.928148 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:25.928151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:25.928391 (+ 240us) server_negotiation.cc:407] Connection header received
0811 10:06:25.928938 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:25.928939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:25.928954 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:25.929006 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:25.929649 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.930127 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.931071 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.931253 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.931302 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.932041 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:25.932042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:25.932043 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:25.932047 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:25.932061 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:25.932065 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:25.932104 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:25.932152 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 10:06:25.932179 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 10:06:25.932462 31855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:25.928053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:41527 (local address 127.9.127.193:42185)
0811 10:06:25.928258 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:25.928293 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:25.928832 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:25.929063 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:25.929066 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:25.929080 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:25.929574 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.929580 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.930207 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.930208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.930991 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:25.930992 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:25.931328 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:25.931329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:25.931436 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:25.931910 (+ 474us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:25.931911 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:25.931939 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:25.931962 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:25.932105 (+ 143us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:25.932107 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:25.932109 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 10:06:25.932154 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 10:06:25.932227 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
I20260811 10:06:25.933075 31853 heartbeater.cc:347] Connected to a master server at 127.9.127.254:41527
I20260811 10:06:25.933156 31853 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:25.933295 31853 heartbeater.cc:511] Master 127.9.127.254:41527 requested a full tablet report, sending...
I20260811 10:06:25.933787 31640 ts_manager.cc:194] Registered new tserver with Master: f08cc30b87d94573a6f01745fc142f3e (127.9.127.193:44059)
I20260811 10:06:25.934417 31640 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.193:42185
I20260811 10:06:25.935228 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 31707
I20260811 10:06:25.935359 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-0/wal/instance
I20260811 10:06:25.935611 9727 external_mini_cluster.cc:1428] Setting key 89ea58d7e14fb80a13cc6f2ad743bedb
I20260811 10:06:25.936478 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.194:0
--local_ip_for_outbound_sockets=127.9.127.194
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41527
--builtin_ntp_servers=127.9.127.212:40729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 10:06:26.017385 31856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:26.017570 31856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:26.017592 31856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:26.018697 31856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:26.018734 31856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:26.018781 31856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.194
I20260811 10:06:26.020073 31856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.127.194
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.194
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:26.020303 31856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:26.020589 31856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:26.025475 31863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:26.025465 31862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:26.025466 31865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:26.025794 31856 server_base.cc:1034] running on GCE node
I20260811 10:06:26.025992 31856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:26.026177 31856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:26.027313 31856 hybrid_clock.cc:648] HybridClock initialized: now 1786442786027303 us; error 27 us; skew 500 ppm
I20260811 10:06:26.028596 31856 webserver.cc:460] Webserver started at http://127.9.127.194:40751/ using document root <none> and password file <none>
I20260811 10:06:26.028893 31856 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:26.028941 31856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:26.029088 31856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:26.030110 31856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/data/instance:
uuid: "f79acd885a614c1283621f1cd444df3f"
format_stamp: "Formatted at 2026-08-11 10:06:26 on dist-test-slave-1x4g"
server_key: "8a65ac64f9fb54be3622f2b41f38777e"
server_key_iv: "fa3e1447ecb60c74ac2717031eb24777"
server_key_version: "encryptionkey@0"
I20260811 10:06:26.030464 31856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance:
uuid: "f79acd885a614c1283621f1cd444df3f"
format_stamp: "Formatted at 2026-08-11 10:06:26 on dist-test-slave-1x4g"
server_key: "8a65ac64f9fb54be3622f2b41f38777e"
server_key_iv: "fa3e1447ecb60c74ac2717031eb24777"
server_key_version: "encryptionkey@0"
I20260811 10:06:26.031774 31856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:26.032495 31872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:26.032699 31856 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:26.032814 31856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/wal
uuid: "f79acd885a614c1283621f1cd444df3f"
format_stamp: "Formatted at 2026-08-11 10:06:26 on dist-test-slave-1x4g"
server_key: "8a65ac64f9fb54be3622f2b41f38777e"
server_key_iv: "fa3e1447ecb60c74ac2717031eb24777"
server_key_version: "encryptionkey@0"
I20260811 10:06:26.032891 31856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:26.052124 31856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:26.052392 31856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:26.052529 31856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:26.052758 31856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:26.053148 31856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:26.053181 31856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:26.053201 31856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:26.053246 31856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:26.059044 31856 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.194:34171
I20260811 10:06:26.059121 31999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.194:34171 every 8 connection(s)
I20260811 10:06:26.059401 31856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/data/info.pb
I20260811 10:06:26.062203 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 31856
I20260811 10:06:26.062332 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/wal/instance
I20260811 10:06:26.062556 9727 external_mini_cluster.cc:1428] Setting key a04f864ed3d17e941c08d89e35125d54
I20260811 10:06:26.063602 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.127.195:0
--local_ip_for_outbound_sockets=127.9.127.195
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41527
--builtin_ntp_servers=127.9.127.212:40729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 10:06:26.064558 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.060048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.194:52471 (local address 127.9.127.254:41527)
0811 10:06:26.060123 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.060125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.060299 (+ 174us) server_negotiation.cc:407] Connection header received
0811 10:06:26.060745 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.060747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.060756 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.060866 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:26.061494 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.061958 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.063135 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.063399 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.063466 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.064305 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:26.064306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:26.064307 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:26.064311 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:26.064325 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:26.064329 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:26.064370 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.064472 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.064496 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:06:26.064857 32002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.059990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:41527 (local address 127.9.127.194:52471)
0811 10:06:26.060189 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:26.060221 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:26.060664 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:26.060941 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:26.060944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:26.060953 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:26.061422 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.061427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.062041 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.062041 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.063043 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.063046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.063496 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.063497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.063671 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.064148 (+ 477us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:26.064148 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:26.064185 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:26.064215 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:26.064392 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:26.064398 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:26.064401 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:26.064473 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 10:06:26.064590 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260811 10:06:26.065310 32000 heartbeater.cc:347] Connected to a master server at 127.9.127.254:41527
I20260811 10:06:26.065414 32000 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:26.065621 32000 heartbeater.cc:511] Master 127.9.127.254:41527 requested a full tablet report, sending...
I20260811 10:06:26.066025 31640 ts_manager.cc:194] Registered new tserver with Master: f79acd885a614c1283621f1cd444df3f (127.9.127.194:34171)
I20260811 10:06:26.066533 31640 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.194:52471
W20260811 10:06:26.145632 32003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:26.145826 32003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:26.145848 32003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:26.146972 32003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:26.147013 32003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:26.147063 32003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.127.195
I20260811 10:06:26.148484 32003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.127.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.127.195
--webserver_port=0
--tserver_master_addrs=127.9.127.254:41527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.127.195
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:26.148718 32003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:26.149065 32003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:26.154006 32014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:26.154072 32011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:26.154191 32003 server_base.cc:1034] running on GCE node
W20260811 10:06:26.154007 32012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:26.154429 32003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:26.154695 32003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:26.155856 32003 hybrid_clock.cc:648] HybridClock initialized: now 1786442786155841 us; error 28 us; skew 500 ppm
I20260811 10:06:26.157090 32003 webserver.cc:460] Webserver started at http://127.9.127.195:39489/ using document root <none> and password file <none>
I20260811 10:06:26.157325 32003 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:26.157393 32003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:26.157552 32003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:26.158572 32003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/data/instance:
uuid: "4a686d511a0a458586162164aff71e38"
format_stamp: "Formatted at 2026-08-11 10:06:26 on dist-test-slave-1x4g"
server_key: "4a621b7b6c93a34e56f9d28d59606317"
server_key_iv: "41f63e2e8685d0a099e9faf6b5bc2c03"
server_key_version: "encryptionkey@0"
I20260811 10:06:26.158936 32003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance:
uuid: "4a686d511a0a458586162164aff71e38"
format_stamp: "Formatted at 2026-08-11 10:06:26 on dist-test-slave-1x4g"
server_key: "4a621b7b6c93a34e56f9d28d59606317"
server_key_iv: "41f63e2e8685d0a099e9faf6b5bc2c03"
server_key_version: "encryptionkey@0"
I20260811 10:06:26.160228 32003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:06:26.160949 32022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:26.161119 32003 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:26.161218 32003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/wal
uuid: "4a686d511a0a458586162164aff71e38"
format_stamp: "Formatted at 2026-08-11 10:06:26 on dist-test-slave-1x4g"
server_key: "4a621b7b6c93a34e56f9d28d59606317"
server_key_iv: "41f63e2e8685d0a099e9faf6b5bc2c03"
server_key_version: "encryptionkey@0"
I20260811 10:06:26.161299 32003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:26.174026 32003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:26.174299 32003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:26.174445 32003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:26.174665 32003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 10:06:26.174998 32003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 10:06:26.175068 32003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:26.175112 32003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 10:06:26.175138 32003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:26.180912 32003 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.195:44597
I20260811 10:06:26.180966 32151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.195:44597 every 8 connection(s)
I20260811 10:06:26.181262 32003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/data/info.pb
I20260811 10:06:26.186223 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.181929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.195:59983 (local address 127.9.127.254:41527)
0811 10:06:26.182001 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.182003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.182237 (+ 234us) server_negotiation.cc:407] Connection header received
0811 10:06:26.182743 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.182744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.182757 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.182812 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:26.183473 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.183945 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.184862 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.185063 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.185143 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.185903 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:26.185904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:26.185904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:26.185909 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:26.185924 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:26.185928 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:26.185995 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.186115 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.186146 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 10:06:26.186424 32155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.181919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:41527 (local address 127.9.127.195:59983)
0811 10:06:26.182124 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:26.182155 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:26.182636 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:26.182879 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:26.182882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:26.182890 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:26.183364 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.183368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.184060 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.184061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.184757 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.184758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.185156 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.185157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.185299 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.185754 (+ 455us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 10:06:26.185754 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:26.185781 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 10:06:26.185803 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:26.186000 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:26.186006 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:26.186010 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 10:06:26.186110 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 10:06:26.186210 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
I20260811 10:06:26.186924 32152 heartbeater.cc:347] Connected to a master server at 127.9.127.254:41527
I20260811 10:06:26.187006 32152 heartbeater.cc:464] Registering TS with master...
I20260811 10:06:26.187143 32152 heartbeater.cc:511] Master 127.9.127.254:41527 requested a full tablet report, sending...
I20260811 10:06:26.187480 31640 ts_manager.cc:194] Registered new tserver with Master: 4a686d511a0a458586162164aff71e38 (127.9.127.195:44597)
I20260811 10:06:26.187796 31640 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.127.195:59983
I20260811 10:06:26.189878 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 32003
I20260811 10:06:26.190016 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/wal/instance
I20260811 10:06:26.190218 9727 external_mini_cluster.cc:1428] Setting key 6048315146b989647cd3f8a7734a493d
I20260811 10:06:26.190943 9727 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 10:06:26.194952 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.192310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35944 (local address 127.9.127.254:41527)
0811 10:06:26.192369 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.192371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.192469 (+ 98us) server_negotiation.cc:407] Connection header received
0811 10:06:26.192511 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.192512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.192521 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.192565 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:26.192696 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.193238 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.193940 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.194128 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.194189 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.194795 (+ 606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:26.194795 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:26.194796 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:26.194800 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:26.194810 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:26.194813 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:26.194852 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.194885 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.194903 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 10:06:26.196574 31640 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35944:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 10:06:26.198145 31640 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 10:06:26.204106 32165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.200119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:44597 (local address 127.0.0.1:59042)
0811 10:06:26.200397 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:26.200409 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:26.200461 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:26.200809 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:26.200810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:26.200812 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:26.200874 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.200875 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.201821 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.201822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.203047 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.203050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.203821 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.203822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.203904 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.203917 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 10:06:26.203980 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 10:06:26.204034 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":82,"threads_started":1}
I20260811 10:06:26.204118 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.200285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59042 (local address 127.9.127.195:44597)
0811 10:06:26.200621 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.200625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.200633 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:06:26.200663 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.200665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.200677 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.200952 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:26.201000 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.201733 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.203142 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.203729 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.203818 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.203909 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.204011 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.204045 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":75,"threads_started":1}
I20260811 10:06:26.204329 32164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.200119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:44059 (local address 127.0.0.1:38946)
0811 10:06:26.200287 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:26.200321 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:26.200415 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:26.200921 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:26.200922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:26.200924 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:26.200958 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.200960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.202286 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.202287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.203166 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.203168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.204110 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.204111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.204179 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.204184 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:06:26.204218 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 10:06:26.204267 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
I20260811 10:06:26.204701 32168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.200446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38946 (local address 127.9.127.193:44059)
0811 10:06:26.200703 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.200706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.200714 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:06:26.200770 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.200772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.200817 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.201032 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:26.201097 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.202187 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.203250 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.203998 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.204436 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.204540 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.204565 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.204616 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":87,"threads_started":1}
I20260811 10:06:26.204741 32163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.200148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:34171 (local address 127.0.0.1:50564)
0811 10:06:26.200540 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:26.200548 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:26.200594 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:26.200799 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:26.200802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:26.200804 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:26.200885 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.200887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.202242 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.202243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.203310 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.203313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.204533 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.204534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.204596 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.204599 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:26.204630 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 10:06:26.204666 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":26,"thread_start_us":90,"threads_started":1}
I20260811 10:06:26.204908 32078 tablet_service.cc:1467] Processing CreateTablet for tablet 491556f848a048cd870cd0c8b3e3d340 (DEFAULT_TABLE table=test-table [id=91475554c6de4ad5a33e558a73e18318]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:26.205139 32167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.200403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50564 (local address 127.9.127.194:34171)
0811 10:06:26.200576 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.200581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.200592 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:06:26.200659 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.200660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.200676 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.200761 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:26.200972 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.202136 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.203397 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.204096 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.204865 (+ 769us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.204963 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.204990 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.205036 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
I20260811 10:06:26.205289 32078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491556f848a048cd870cd0c8b3e3d340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:26.205386 31777 tablet_service.cc:1467] Processing CreateTablet for tablet 491556f848a048cd870cd0c8b3e3d340 (DEFAULT_TABLE table=test-table [id=91475554c6de4ad5a33e558a73e18318]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:26.205677 31777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491556f848a048cd870cd0c8b3e3d340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:26.208696 32169 tablet_bootstrap.cc:492] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: Bootstrap starting.
I20260811 10:06:26.208974 32170 tablet_bootstrap.cc:492] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e: Bootstrap starting.
I20260811 10:06:26.209281 31926 tablet_service.cc:1467] Processing CreateTablet for tablet 491556f848a048cd870cd0c8b3e3d340 (DEFAULT_TABLE table=test-table [id=91475554c6de4ad5a33e558a73e18318]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 10:06:26.209596 31926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491556f848a048cd870cd0c8b3e3d340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:26.209692 32170 tablet_bootstrap.cc:654] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:26.209692 32169 tablet_bootstrap.cc:654] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:26.210037 32169 log.cc:824] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:26.210037 32170 log.cc:824] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:26.210816 32169 tablet_bootstrap.cc:492] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: No bootstrap required, opened a new log
I20260811 10:06:26.210824 32170 tablet_bootstrap.cc:492] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e: No bootstrap required, opened a new log
I20260811 10:06:26.210891 32169 ts_tablet_manager.cc:1397] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 10:06:26.210891 32170 ts_tablet_manager.cc:1397] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 10:06:26.212239 32174 tablet_bootstrap.cc:492] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: Bootstrap starting.
I20260811 10:06:26.212917 32174 tablet_bootstrap.cc:654] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:26.213279 32174 log.cc:824] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:26.213506 32169 raft_consensus.cc:348] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.213506 32170 raft_consensus.cc:348] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.213677 32169 raft_consensus.cc:374] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:26.213677 32170 raft_consensus.cc:374] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:26.213716 32169 raft_consensus.cc:729] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a686d511a0a458586162164aff71e38, State: Initialized, Role: FOLLOWER
I20260811 10:06:26.213716 32170 raft_consensus.cc:729] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08cc30b87d94573a6f01745fc142f3e, State: Initialized, Role: FOLLOWER
I20260811 10:06:26.213860 32169 consensus_queue.cc:260] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.213860 32170 consensus_queue.cc:260] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.214053 32174 tablet_bootstrap.cc:492] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: No bootstrap required, opened a new log
I20260811 10:06:26.214118 32174 ts_tablet_manager.cc:1397] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 10:06:26.214120 32170 ts_tablet_manager.cc:1428] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 10:06:26.214120 32169 ts_tablet_manager.cc:1428] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 10:06:26.214262 31853 heartbeater.cc:503] Master 127.9.127.254:41527 was elected leader, sending a full tablet report...
I20260811 10:06:26.214389 32152 heartbeater.cc:503] Master 127.9.127.254:41527 was elected leader, sending a full tablet report...
I20260811 10:06:26.216385 32174 raft_consensus.cc:348] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.216522 32174 raft_consensus.cc:374] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:26.216567 32174 raft_consensus.cc:729] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79acd885a614c1283621f1cd444df3f, State: Initialized, Role: FOLLOWER
I20260811 10:06:26.216711 32174 consensus_queue.cc:260] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.216964 32174 ts_tablet_manager.cc:1428] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 10:06:26.217046 32000 heartbeater.cc:503] Master 127.9.127.254:41527 was elected leader, sending a full tablet report...
I20260811 10:06:26.229092 32177 raft_consensus.cc:482] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 10:06:26.229195 32177 raft_consensus.cc:504] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.229496 32177 leader_election.cc:288] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a686d511a0a458586162164aff71e38 (127.9.127.195:44597), f79acd885a614c1283621f1cd444df3f (127.9.127.194:34171)
I20260811 10:06:26.232323 31855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.229635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.194:34171 (local address 127.9.127.193:44507)
0811 10:06:26.229794 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:26.229805 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:26.229856 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:26.230003 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:26.230004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:26.230006 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:26.230080 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.230082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.230731 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.230732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.231522 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.231524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.232076 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.232077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.232146 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.232149 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 10:06:26.232203 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 10:06:26.232236 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":21}
I20260811 10:06:26.232335 32167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.229826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:44507 (local address 127.9.127.194:34171)
0811 10:06:26.229864 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.229866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.229877 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:06:26.229905 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.229906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.229916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.229972 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:26.230157 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.230653 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.231636 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.231998 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.232051 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.232057 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.232226 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.232273 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:06:26.232398 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.229764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.9.127.193:40867 (local address 127.9.127.195:44597)
0811 10:06:26.229803 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.229805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.229986 (+ 181us) server_negotiation.cc:407] Connection header received
0811 10:06:26.230013 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.230013 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.230024 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.230080 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 10:06:26.230254 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.230713 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.231675 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.232045 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.232115 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.232122 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.232296 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.232332 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 10:06:26.232435 32179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.229635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.195:44597 (local address 127.9.127.193:40867)
0811 10:06:26.229866 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:26.229877 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:26.229939 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:26.230086 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:26.230086 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:26.230088 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 10:06:26.230178 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.230179 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.230795 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.230795 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.231537 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:26.231539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.232131 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.232132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:26.232216 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.232221 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 10:06:26.232277 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 10:06:26.232311 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":27,"thread_start_us":78,"threads_started":1}
I20260811 10:06:26.232686 32099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "491556f848a048cd870cd0c8b3e3d340" candidate_uuid: "f08cc30b87d94573a6f01745fc142f3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a686d511a0a458586162164aff71e38" is_pre_election: true
I20260811 10:06:26.232682 31948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "491556f848a048cd870cd0c8b3e3d340" candidate_uuid: "f08cc30b87d94573a6f01745fc142f3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79acd885a614c1283621f1cd444df3f" is_pre_election: true
I20260811 10:06:26.232833 32099 raft_consensus.cc:2454] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f08cc30b87d94573a6f01745fc142f3e in term 0.
I20260811 10:06:26.232837 31948 raft_consensus.cc:2454] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f08cc30b87d94573a6f01745fc142f3e in term 0.
I20260811 10:06:26.233058 31725 leader_election.cc:302] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f08cc30b87d94573a6f01745fc142f3e, f79acd885a614c1283621f1cd444df3f; no voters:
I20260811 10:06:26.233258 32177 raft_consensus.cc:2781] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 10:06:26.233309 32177 raft_consensus.cc:482] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 10:06:26.233325 32177 raft_consensus.cc:3037] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:26.233990 32177 raft_consensus.cc:504] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.234126 32177 leader_election.cc:288] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [CANDIDATE]: Term 1 election: Requested vote from peers 4a686d511a0a458586162164aff71e38 (127.9.127.195:44597), f79acd885a614c1283621f1cd444df3f (127.9.127.194:34171)
I20260811 10:06:26.234318 31948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "491556f848a048cd870cd0c8b3e3d340" candidate_uuid: "f08cc30b87d94573a6f01745fc142f3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79acd885a614c1283621f1cd444df3f"
I20260811 10:06:26.234318 32099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "491556f848a048cd870cd0c8b3e3d340" candidate_uuid: "f08cc30b87d94573a6f01745fc142f3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a686d511a0a458586162164aff71e38"
I20260811 10:06:26.234387 32099 raft_consensus.cc:3037] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:26.234387 31948 raft_consensus.cc:3037] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:26.235245 32099 raft_consensus.cc:2454] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08cc30b87d94573a6f01745fc142f3e in term 1.
I20260811 10:06:26.235245 31948 raft_consensus.cc:2454] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08cc30b87d94573a6f01745fc142f3e in term 1.
I20260811 10:06:26.235445 31725 leader_election.cc:302] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f08cc30b87d94573a6f01745fc142f3e, f79acd885a614c1283621f1cd444df3f; no voters:
I20260811 10:06:26.235555 32177 raft_consensus.cc:2781] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:26.235710 32177 raft_consensus.cc:686] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 1 LEADER]: Becoming Leader. State: Replica: f08cc30b87d94573a6f01745fc142f3e, State: Running, Role: LEADER
I20260811 10:06:26.235842 32177 consensus_queue.cc:237] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } }
I20260811 10:06:26.236645 31639 catalog_manager.cc:5495] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e reported cstate change: term changed from 0 to 1, leader changed from <none> to f08cc30b87d94573a6f01745fc142f3e (127.9.127.193). New cstate: current_term: 1 leader_uuid: "f08cc30b87d94573a6f01745fc142f3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08cc30b87d94573a6f01745fc142f3e" member_type: VOTER last_known_addr { host: "127.9.127.193" port: 44059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 } health_report { overall_health: UNKNOWN } } }
I20260811 10:06:26.246644 32168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.244305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38948 (local address 127.9.127.193:44059)
0811 10:06:26.244349 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:26.244351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:26.244359 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:06:26.244393 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:26.244394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:26.244417 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:26.244511 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:26.244634 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.245139 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.245880 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:26.246062 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:26.246130 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:26.246300 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:26.246410 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:26.246507 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:26.246527 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 10:06:26.246546 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:06:26.248297 32099 raft_consensus.cc:1261] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 1 FOLLOWER]: Refusing update from remote peer f08cc30b87d94573a6f01745fc142f3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:26.248298 31948 raft_consensus.cc:1261] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 1 FOLLOWER]: Refusing update from remote peer f08cc30b87d94573a6f01745fc142f3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:26.248634 32177 consensus_queue.cc:1035] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a686d511a0a458586162164aff71e38" member_type: VOTER last_known_addr { host: "127.9.127.195" port: 44597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:26.248800 32180 consensus_queue.cc:1035] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79acd885a614c1283621f1cd444df3f" member_type: VOTER last_known_addr { host: "127.9.127.194" port: 34171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:26.251166 32183 mvcc.cc:205] Tried to move back new op lower bound from 7317269652470468608 to 7317269652422729728. Current Snapshot: MvccSnapshot[applied={T|T < 7317269652470468608}]
I20260811 10:06:26.251950 32185 mvcc.cc:205] Tried to move back new op lower bound from 7317269652470468608 to 7317269652422729728. Current Snapshot: MvccSnapshot[applied={T|T < 7317269652470468608}]
I20260811 10:06:26.252041 32184 mvcc.cc:205] Tried to move back new op lower bound from 7317269652470468608 to 7317269652422729728. Current Snapshot: MvccSnapshot[applied={T|T < 7317269652470468608}]
I20260811 10:06:26.253545 31640 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:26.253628 31640 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 10:06:26.254381 31640 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5a0ae94d97a4f1aac15ecf1bb796469: Sending DeleteTablet for 3 replicas of tablet 491556f848a048cd870cd0c8b3e3d340
I20260811 10:06:26.254707 31777 tablet_service.cc:1514] Processing DeleteTablet for tablet 491556f848a048cd870cd0c8b3e3d340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:26 UTC) from {username='slave'} at 127.0.0.1:38946
I20260811 10:06:26.254721 32078 tablet_service.cc:1514] Processing DeleteTablet for tablet 491556f848a048cd870cd0c8b3e3d340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:26 UTC) from {username='slave'} at 127.0.0.1:59042
I20260811 10:06:26.254724 31926 tablet_service.cc:1514] Processing DeleteTablet for tablet 491556f848a048cd870cd0c8b3e3d340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 10:06:26 UTC) from {username='slave'} at 127.0.0.1:50564
I20260811 10:06:26.254920 32193 tablet_replica.cc:330] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e: stopping tablet replica
I20260811 10:06:26.255002 32196 tablet_replica.cc:330] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: stopping tablet replica
I20260811 10:06:26.255019 32193 raft_consensus.cc:2229] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 1 LEADER]: Raft consensus shutting down.
I20260811 10:06:26.255126 32193 raft_consensus.cc:2258] T 491556f848a048cd870cd0c8b3e3d340 P f08cc30b87d94573a6f01745fc142f3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:26.255177 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 31707
I20260811 10:06:26.255142 32196 raft_consensus.cc:2229] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:26.255329 32196 raft_consensus.cc:2258] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:26.255894 32196 ts_tablet_manager.cc:1905] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:26.257493 32196 ts_tablet_manager.cc:1918] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:26.257579 32196 log.cc:1196] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-1/wal/wals/491556f848a048cd870cd0c8b3e3d340
I20260811 10:06:26.257817 32196 ts_tablet_manager.cc:1939] T 491556f848a048cd870cd0c8b3e3d340 P f79acd885a614c1283621f1cd444df3f: Deleting consensus metadata
I20260811 10:06:26.258198 31627 catalog_manager.cc:4841] TS f79acd885a614c1283621f1cd444df3f (127.9.127.194:34171): tablet 491556f848a048cd870cd0c8b3e3d340 (table test-table [id=91475554c6de4ad5a33e558a73e18318]) successfully deleted
I20260811 10:06:26.260977 32194 tablet_replica.cc:330] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: stopping tablet replica
I20260811 10:06:26.261097 32194 raft_consensus.cc:2229] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 10:06:26.261209 32194 raft_consensus.cc:2258] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 10:06:26.261617 32194 ts_tablet_manager.cc:1905] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 10:06:26.263213 32194 ts_tablet_manager.cc:1918] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 10:06:26.263300 32194 log.cc:1196] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: Deleting WAL directory at /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786442543469380-9727-0/minicluster-data/ts-2/wal/wals/491556f848a048cd870cd0c8b3e3d340
I20260811 10:06:26.263551 32194 ts_tablet_manager.cc:1939] T 491556f848a048cd870cd0c8b3e3d340 P 4a686d511a0a458586162164aff71e38: Deleting consensus metadata
I20260811 10:06:26.263988 31625 catalog_manager.cc:4841] TS 4a686d511a0a458586162164aff71e38 (127.9.127.195:44597): tablet 491556f848a048cd870cd0c8b3e3d340 (table test-table [id=91475554c6de4ad5a33e558a73e18318]) successfully deleted
W20260811 10:06:26.265152 31624 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.127.193:44059 (error 108)
I20260811 10:06:26.265398 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 31856
I20260811 10:06:26.268069 32163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:26.265503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.193:44059 (local address 127.0.0.1:38958)
0811 10:06:26.267992 (+ 2489us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:26.268040 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.193:44059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2464}
W20260811 10:06:26.272451 31624 catalog_manager.cc:4584] TS f08cc30b87d94573a6f01745fc142f3e (127.9.127.193:44059): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 491556f848a048cd870cd0c8b3e3d340: Network error: Client connection negotiation failed: client connection to 127.9.127.193:44059: connect: Connection refused (error 111)
I20260811 10:06:26.276285 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 32003
I20260811 10:06:26.282459 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 31608
2026-08-11T10:06:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (687 ms)
[----------] 6 tests from EncryptionPolicyTest (8636 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:26 dist-test-slave-1x4g krb5kdc[32200](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:26 dist-test-slave-1x4g krb5kdc[32200](info): set up 2 sockets
Aug 11 10:06:26 dist-test-slave-1x4g krb5kdc[32200](info): commencing operation
krb5kdc: starting...
W20260811 10:06:27.375058 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:27 dist-test-slave-1x4g krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:27.495126 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36097
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:27.577463 32214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:27.577669 32214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:27.577694 32214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:27.578760 32214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:27.578794 32214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:27.578809 32214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:27.578820 32214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:27.578832 32214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:27.580317 32214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36097
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:27.580520 32214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:27.580703 32214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:27.585456 32220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:27.585470 32223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:27.585470 32219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:27.585740 32214 server_base.cc:1034] running on GCE node
I20260811 10:06:27.586016 32214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:27.586323 32214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:27.587488 32214 hybrid_clock.cc:648] HybridClock initialized: now 1786442787587482 us; error 35 us; skew 500 ppm
Aug 11 10:06:27 dist-test-slave-1x4g krb5kdc[32200](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442787, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:27.590034 32214 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:27.590468 32214 webserver.cc:460] Webserver started at http://127.0.0.1:42595/ using document root <none> and password file <none>
I20260811 10:06:27.590719 32214 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:27.590790 32214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:27.590942 32214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:27.591981 32214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "11a0b6e6256f47338f2731dc6d11e39c"
format_stamp: "Formatted at 2026-08-11 10:06:27 on dist-test-slave-1x4g"
server_key: "000a26fd3c70886be2f6c82c4a5ae07a"
server_key_iv: "843f3d2154ebec5c08283f9c46dc8c53"
server_key_version: "encryptionkey@0"
I20260811 10:06:27.592351 32214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "11a0b6e6256f47338f2731dc6d11e39c"
format_stamp: "Formatted at 2026-08-11 10:06:27 on dist-test-slave-1x4g"
server_key: "000a26fd3c70886be2f6c82c4a5ae07a"
server_key_iv: "843f3d2154ebec5c08283f9c46dc8c53"
server_key_version: "encryptionkey@0"
I20260811 10:06:27.593756 32214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:06:27.594496 32230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:27.594663 32214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:27.594770 32214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "11a0b6e6256f47338f2731dc6d11e39c"
format_stamp: "Formatted at 2026-08-11 10:06:27 on dist-test-slave-1x4g"
server_key: "000a26fd3c70886be2f6c82c4a5ae07a"
server_key_iv: "843f3d2154ebec5c08283f9c46dc8c53"
server_key_version: "encryptionkey@0"
I20260811 10:06:27.594843 32214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:27.604502 32214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:27.606268 32214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:27.606421 32214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:27.610500 32214 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36097
I20260811 10:06:27.610535 32287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36097 every 8 connection(s)
I20260811 10:06:27.610908 32214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:27.611929 32288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:27.614319 32288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c: Bootstrap starting.
I20260811 10:06:27.614933 32288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:27.615244 32288 log.cc:824] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:27.615942 32288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c: No bootstrap required, opened a new log
I20260811 10:06:27.617645 32288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a0b6e6256f47338f2731dc6d11e39c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36097 } }
I20260811 10:06:27.617781 32288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:27.617803 32288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11a0b6e6256f47338f2731dc6d11e39c, State: Initialized, Role: FOLLOWER
I20260811 10:06:27.617995 32288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a0b6e6256f47338f2731dc6d11e39c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36097 } }
I20260811 10:06:27.618078 32288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:27.618130 32288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:27.618181 32288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:27.618721 32288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a0b6e6256f47338f2731dc6d11e39c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36097 } }
I20260811 10:06:27.618836 32288 leader_election.cc:302] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11a0b6e6256f47338f2731dc6d11e39c; no voters:
I20260811 10:06:27.619029 32288 leader_election.cc:288] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:27.619086 32291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:27.619248 32291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [term 1 LEADER]: Becoming Leader. State: Replica: 11a0b6e6256f47338f2731dc6d11e39c, State: Running, Role: LEADER
I20260811 10:06:27.619304 32288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:27.619331 32291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a0b6e6256f47338f2731dc6d11e39c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36097 } }
I20260811 10:06:27.619774 32293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11a0b6e6256f47338f2731dc6d11e39c. Latest consensus state: current_term: 1 leader_uuid: "11a0b6e6256f47338f2731dc6d11e39c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a0b6e6256f47338f2731dc6d11e39c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36097 } } }
I20260811 10:06:27.619884 32293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:27.619904 32292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11a0b6e6256f47338f2731dc6d11e39c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11a0b6e6256f47338f2731dc6d11e39c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36097 } } }
I20260811 10:06:27.619958 32292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:27.620209 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 32214
I20260811 10:06:27.620350 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:27.620568 9727 external_mini_cluster.cc:1428] Setting key 2a200cd7165aa241c8dce2066070ca50
W20260811 10:06:27.621228 32309 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:27.621291 32309 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:27.621351 32299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:27.621529 32299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:27.622947 32299 catalog_manager.cc:1347] Generated new cluster ID: 9b7e27a89c19460e9669648c7cda40d9
I20260811 10:06:27.622998 32299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:06:27 dist-test-slave-1x4g krb5kdc[32200](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 10:06:27.632792 32299 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:27.633487 32299 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:27.633526 32313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:27.621110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55629 (local address 127.0.0.1:36097)
0811 10:06:27.621294 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:27.621304 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:27.622049 (+ 745us) server_negotiation.cc:407] Connection header received
0811 10:06:27.622163 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:27.622170 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:27.622223 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:27.622385 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:27.623230 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:27.624623 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:27.625782 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:27.626369 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:27.626463 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:27.629424 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:27.629428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:27.629429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:27.629442 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:27.631535 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:27.631977 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:27.631981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:27.631982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:27.632101 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:27.632375 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:27.632376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:27.632376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:27.632687 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:27.632897 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:27.633186 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 10:06:27.633295 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":79,"threads_started":1}
I20260811 10:06:27.634558 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:27.642927 32313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:27.635934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53819 (local address 127.0.0.1:36097)
0811 10:06:27.635967 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:27.635969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:27.636023 (+ 54us) server_negotiation.cc:407] Connection header received
0811 10:06:27.636091 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:27.636091 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:27.636100 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:27.636163 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:27.636731 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:27.637547 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:27.638551 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:27.638889 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:27.638966 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:27.640189 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:27.640191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:27.640191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:27.640198 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:27.641738 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:27.642132 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:27.642133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:27.642133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:27.642192 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:27.642410 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:27.642411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:27.642411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:27.642564 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:27.642666 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:27.642779 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 10:06:27.642842 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:06:27.648736 32299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11a0b6e6256f47338f2731dc6d11e39c: Generated new TSK 0
I20260811 10:06:27.648926 32299 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:27.653272 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 32214
W20260811 10:06:27.661161 32198 connection.cc:535] client connection to 127.0.0.1:36097 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36097): Connection reset by peer (error 104)
2026-08-11T10:06:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1371 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:27 dist-test-slave-1x4g krb5kdc[32323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:27 dist-test-slave-1x4g krb5kdc[32323](info): set up 2 sockets
Aug 11 10:06:27 dist-test-slave-1x4g krb5kdc[32323](info): commencing operation
krb5kdc: starting...
W20260811 10:06:28.734622 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:28 dist-test-slave-1x4g krb5kdc[32323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:28.859301 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46853
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:28.942049 32338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:28.942273 32338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:28.942308 32338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:28.943431 32338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:28.943497 32338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:28.943521 32338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:28.943542 32338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:28.943569 32338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:28.945052 32338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46853
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:28.945325 32338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:28.945544 32338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:28.950302 32344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:28.950340 32347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:28.950314 32345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:28.950521 32338 server_base.cc:1034] running on GCE node
I20260811 10:06:28.950770 32338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:28.951092 32338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:28.952258 32338 hybrid_clock.cc:648] HybridClock initialized: now 1786442788952255 us; error 36 us; skew 500 ppm
Aug 11 10:06:28 dist-test-slave-1x4g krb5kdc[32323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442788, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:28.954844 32338 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:28.955253 32338 webserver.cc:460] Webserver started at http://127.0.0.1:38373/ using document root <none> and password file <none>
I20260811 10:06:28.955471 32338 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:28.955546 32338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:28.955699 32338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:28.956758 32338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "a639960f7f1b4e869e50f80f6335d3df"
format_stamp: "Formatted at 2026-08-11 10:06:28 on dist-test-slave-1x4g"
server_key: "d3cab868abc21b355851a4b2bdcb4ef5"
server_key_iv: "7f594aeed68957d6320d65d781881bc1"
server_key_version: "encryptionkey@0"
I20260811 10:06:28.957211 32338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "a639960f7f1b4e869e50f80f6335d3df"
format_stamp: "Formatted at 2026-08-11 10:06:28 on dist-test-slave-1x4g"
server_key: "d3cab868abc21b355851a4b2bdcb4ef5"
server_key_iv: "7f594aeed68957d6320d65d781881bc1"
server_key_version: "encryptionkey@0"
I20260811 10:06:28.958568 32338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:28.959296 32354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:28.959458 32338 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:28.959566 32338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "a639960f7f1b4e869e50f80f6335d3df"
format_stamp: "Formatted at 2026-08-11 10:06:28 on dist-test-slave-1x4g"
server_key: "d3cab868abc21b355851a4b2bdcb4ef5"
server_key_iv: "7f594aeed68957d6320d65d781881bc1"
server_key_version: "encryptionkey@0"
I20260811 10:06:28.959637 32338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:28.972981 32338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:28.975338 32338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:28.975510 32338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:28.979557 32338 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46853
I20260811 10:06:28.979606 32411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46853 every 8 connection(s)
I20260811 10:06:28.980008 32338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:28.981101 32412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:28.983354 32412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df: Bootstrap starting.
I20260811 10:06:28.983923 32412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:28.984171 32412 log.cc:824] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:28.984391 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 32338
I20260811 10:06:28.984519 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:28.984710 9727 external_mini_cluster.cc:1428] Setting key f9e0924281e8311f727b8e9897e164df
I20260811 10:06:28.985105 32412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df: No bootstrap required, opened a new log
I20260811 10:06:28.986866 32412 raft_consensus.cc:348] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a639960f7f1b4e869e50f80f6335d3df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46853 } }
I20260811 10:06:28.987037 32412 raft_consensus.cc:374] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:28.987095 32412 raft_consensus.cc:729] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a639960f7f1b4e869e50f80f6335d3df, State: Initialized, Role: FOLLOWER
I20260811 10:06:28.987232 32412 consensus_queue.cc:260] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a639960f7f1b4e869e50f80f6335d3df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46853 } }
I20260811 10:06:28.987330 32412 raft_consensus.cc:388] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:28.987355 32412 raft_consensus.cc:482] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:28.987419 32412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:28.987955 32412 raft_consensus.cc:504] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a639960f7f1b4e869e50f80f6335d3df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46853 } }
I20260811 10:06:28.988083 32412 leader_election.cc:302] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a639960f7f1b4e869e50f80f6335d3df; no voters:
I20260811 10:06:28.988282 32412 leader_election.cc:288] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:28.988305 32417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:28.988435 32417 raft_consensus.cc:686] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [term 1 LEADER]: Becoming Leader. State: Replica: a639960f7f1b4e869e50f80f6335d3df, State: Running, Role: LEADER
I20260811 10:06:28.988520 32417 consensus_queue.cc:237] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a639960f7f1b4e869e50f80f6335d3df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46853 } }
I20260811 10:06:28.988561 32412 sys_catalog.cc:564] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:28.988926 32418 sys_catalog.cc:455] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a639960f7f1b4e869e50f80f6335d3df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a639960f7f1b4e869e50f80f6335d3df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46853 } } }
I20260811 10:06:28.989198 32418 sys_catalog.cc:458] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:28.989130 32419 sys_catalog.cc:455] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [sys.catalog]: SysCatalogTable state changed. Reason: New leader a639960f7f1b4e869e50f80f6335d3df. Latest consensus state: current_term: 1 leader_uuid: "a639960f7f1b4e869e50f80f6335d3df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a639960f7f1b4e869e50f80f6335d3df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46853 } } }
I20260811 10:06:28.989660 32419 sys_catalog.cc:458] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:28.989815 32429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:28.990340 32429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:28.992216 32429 catalog_manager.cc:1347] Generated new cluster ID: 41581dd4efc946b2a932ba09b640d54d
I20260811 10:06:28.992255 32416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:28.985258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36591 (local address 127.0.0.1:46853)
0811 10:06:28.985438 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:28.985445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:28.985470 (+ 25us) server_negotiation.cc:407] Connection header received
0811 10:06:28.986850 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:28.986857 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:28.986902 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:28.987015 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:28.987313 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:28.988903 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:28.990085 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:28.990676 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:28.990798 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:28.991468 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:28.991472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:28.991473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:28.991705 (+ 232us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:28.991743 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:28.991764 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:28.991888 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:28.991979 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 10:06:28.992008 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260811 10:06:28.992272 32429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:28.993650 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:28.999531 32429 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:28.999816 32416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:28.994993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55233 (local address 127.0.0.1:46853)
0811 10:06:28.995029 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:28.995031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:28.996947 (+ 1916us) server_negotiation.cc:407] Connection header received
0811 10:06:28.997019 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:28.997020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:28.997031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:28.997074 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:28.997225 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:28.997701 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:28.998453 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:28.998682 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:28.998759 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:28.999498 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:28.999499 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:28.999499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:28.999504 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:28.999519 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:28.999524 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:28.999599 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:28.999712 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 10:06:28.999725 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:06:29.000177 32429 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:29.005707 32429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a639960f7f1b4e869e50f80f6335d3df: Generated new TSK 0
I20260811 10:06:29.005874 32429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:29.010732 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 32338
W20260811 10:06:29.018215 32321 connection.cc:535] client connection to 127.0.0.1:46853 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46853): Connection reset by peer (error 104)
2026-08-11T10:06:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1356 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:29 dist-test-slave-1x4g krb5kdc[32447](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:29 dist-test-slave-1x4g krb5kdc[32447](info): set up 2 sockets
Aug 11 10:06:29 dist-test-slave-1x4g krb5kdc[32447](info): commencing operation
krb5kdc: starting...
W20260811 10:06:30.095587 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:30 dist-test-slave-1x4g krb5kdc[32447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:30.215452 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35407
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35407
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:30.297438 32462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:30.297675 32462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:30.297712 32462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:30.298839 32462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:30.298909 32462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:30.298933 32462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:30.298960 32462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:30.298992 32462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:30.300439 32462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35407
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:30.300709 32462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:30.300974 32462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:30.305776 32469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:30.305797 32468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:30.305845 32462 server_base.cc:1034] running on GCE node
W20260811 10:06:30.305787 32471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:30.306239 32462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:30.306528 32462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:30.307693 32462 hybrid_clock.cc:648] HybridClock initialized: now 1786442790307677 us; error 27 us; skew 500 ppm
Aug 11 10:06:30 dist-test-slave-1x4g krb5kdc[32447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442790, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:30.315413 32462 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:30.315881 32462 webserver.cc:460] Webserver started at http://127.0.0.1:43731/ using document root <none> and password file <none>
I20260811 10:06:30.316064 32462 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:30.316112 32462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:30.316198 32462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:30.317256 32462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "a982875fada7463d8e58adf5a46cb7e4"
format_stamp: "Formatted at 2026-08-11 10:06:30 on dist-test-slave-1x4g"
server_key: "24f3b3f69b5c581c44d5e2d120007200"
server_key_iv: "4483bf9bbd69fd1bbde268feda01f9bb"
server_key_version: "encryptionkey@0"
I20260811 10:06:30.317566 32462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "a982875fada7463d8e58adf5a46cb7e4"
format_stamp: "Formatted at 2026-08-11 10:06:30 on dist-test-slave-1x4g"
server_key: "24f3b3f69b5c581c44d5e2d120007200"
server_key_iv: "4483bf9bbd69fd1bbde268feda01f9bb"
server_key_version: "encryptionkey@0"
I20260811 10:06:30.318835 32462 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:30.319535 32480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:30.319716 32462 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:30.319835 32462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "a982875fada7463d8e58adf5a46cb7e4"
format_stamp: "Formatted at 2026-08-11 10:06:30 on dist-test-slave-1x4g"
server_key: "24f3b3f69b5c581c44d5e2d120007200"
server_key_iv: "4483bf9bbd69fd1bbde268feda01f9bb"
server_key_version: "encryptionkey@0"
I20260811 10:06:30.319893 32462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:30.323200 32462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:30.325232 32462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:30.325402 32462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:30.329581 32462 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35407
I20260811 10:06:30.329649 32538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35407 every 8 connection(s)
I20260811 10:06:30.329947 32462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:30.330219 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 32462
I20260811 10:06:30.330353 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:30.330641 9727 external_mini_cluster.cc:1428] Setting key 0ed999dcb17672366effc8fb0a2a582a
I20260811 10:06:30.331229 32540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:30.333110 32543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:30.331208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58755 (local address 127.0.0.1:35407)
0811 10:06:30.331426 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:30.331433 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:30.331459 (+ 26us) server_negotiation.cc:407] Connection header received
0811 10:06:30.331875 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:30.331881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:30.331903 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:30.332011 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:30.332623 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:30.332626 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:30.332627 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:30.332630 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:30.332665 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:30.332675 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:30.332731 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:30.332863 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 10:06:30.332924 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":94,"threads_started":1}
I20260811 10:06:30.334049 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:30.334582 32540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4: Bootstrap starting.
I20260811 10:06:30.335196 32540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:30.335553 32540 log.cc:824] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:30.336383 32540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4: No bootstrap required, opened a new log
I20260811 10:06:30.336534 32543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:30.335466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35869 (local address 127.0.0.1:35407)
0811 10:06:30.335508 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:30.335509 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:30.335583 (+ 74us) server_negotiation.cc:407] Connection header received
0811 10:06:30.335696 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:30.335697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:30.335702 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:30.335765 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:30.336322 (+ 557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:30.336323 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:30.336323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:30.336326 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:30.336337 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:30.336341 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:30.336383 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:30.336453 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 10:06:30.336465 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 10:06:30.338425 32540 raft_consensus.cc:348] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a982875fada7463d8e58adf5a46cb7e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35407 } }
I20260811 10:06:30.338577 32540 raft_consensus.cc:374] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:30.338601 32540 raft_consensus.cc:729] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982875fada7463d8e58adf5a46cb7e4, State: Initialized, Role: FOLLOWER
I20260811 10:06:30.338711 32540 consensus_queue.cc:260] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a982875fada7463d8e58adf5a46cb7e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35407 } }
I20260811 10:06:30.338788 32540 raft_consensus.cc:388] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:30.338809 32540 raft_consensus.cc:482] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:30.338836 32540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:30.339349 32540 raft_consensus.cc:504] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a982875fada7463d8e58adf5a46cb7e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35407 } }
I20260811 10:06:30.339433 32540 leader_election.cc:302] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a982875fada7463d8e58adf5a46cb7e4; no voters:
I20260811 10:06:30.339608 32540 leader_election.cc:288] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:30.339691 32552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:30.339843 32552 raft_consensus.cc:686] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [term 1 LEADER]: Becoming Leader. State: Replica: a982875fada7463d8e58adf5a46cb7e4, State: Running, Role: LEADER
I20260811 10:06:30.339880 32540 sys_catalog.cc:564] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:30.339972 32552 consensus_queue.cc:237] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a982875fada7463d8e58adf5a46cb7e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35407 } }
I20260811 10:06:30.340370 32553 sys_catalog.cc:455] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a982875fada7463d8e58adf5a46cb7e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a982875fada7463d8e58adf5a46cb7e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35407 } } }
I20260811 10:06:30.340466 32553 sys_catalog.cc:458] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:30.340669 32554 sys_catalog.cc:455] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a982875fada7463d8e58adf5a46cb7e4. Latest consensus state: current_term: 1 leader_uuid: "a982875fada7463d8e58adf5a46cb7e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a982875fada7463d8e58adf5a46cb7e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35407 } } }
I20260811 10:06:30.340741 32554 sys_catalog.cc:458] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4 [sys.catalog]: This master's current role is: LEADER
W20260811 10:06:30.341823 32570 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:30.341888 32570 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:30.341944 32563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:30.342092 32563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:30.343470 32563 catalog_manager.cc:1347] Generated new cluster ID: dc7abe74672f4931add03a6316b77526
I20260811 10:06:30.343529 32563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:30.352025 32563 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:30.352193 32563 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:30.355770 32563 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a982875fada7463d8e58adf5a46cb7e4: Generated new TSK 0
I20260811 10:06:30.355945 32563 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:30.362998 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 32462
2026-08-11T10:06:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1352 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:30 dist-test-slave-1x4g krb5kdc[32577](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:30 dist-test-slave-1x4g krb5kdc[32577](info): set up 2 sockets
Aug 11 10:06:30 dist-test-slave-1x4g krb5kdc[32577](info): commencing operation
krb5kdc: starting...
W20260811 10:06:31.446372 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:31 dist-test-slave-1x4g krb5kdc[32577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:31.571717 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43215
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:31.654625 32591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:31.654876 32591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:31.654913 32591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:31.656054 32591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:31.656122 32591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:31.656145 32591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:31.656167 32591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:31.656196 32591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:31.657714 32591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:31.658000 32591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:31.658231 32591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:31.663100 32599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:31.663100 32596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:31.663161 32597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:31.663324 32591 server_base.cc:1034] running on GCE node
I20260811 10:06:31.663568 32591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:31.663879 32591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:31.665022 32591 hybrid_clock.cc:648] HybridClock initialized: now 1786442791665008 us; error 29 us; skew 500 ppm
Aug 11 10:06:31 dist-test-slave-1x4g krb5kdc[32577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442791, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:31.667464 32591 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:31.667896 32591 webserver.cc:460] Webserver started at http://127.0.0.1:36735/ using document root <none> and password file <none>
I20260811 10:06:31.668138 32591 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:31.668210 32591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:31.668358 32591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:31.669507 32591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "0a285df94246400bafdd0e8490e60349"
format_stamp: "Formatted at 2026-08-11 10:06:31 on dist-test-slave-1x4g"
server_key: "af70f2183aa32dc03307f5abdc4fe2f2"
server_key_iv: "51a5ec511eaabb4d6d47c06f3e86bab7"
server_key_version: "encryptionkey@0"
I20260811 10:06:31.669886 32591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "0a285df94246400bafdd0e8490e60349"
format_stamp: "Formatted at 2026-08-11 10:06:31 on dist-test-slave-1x4g"
server_key: "af70f2183aa32dc03307f5abdc4fe2f2"
server_key_iv: "51a5ec511eaabb4d6d47c06f3e86bab7"
server_key_version: "encryptionkey@0"
I20260811 10:06:31.671295 32591 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:31.671980 32609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:31.672165 32591 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:31.672271 32591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "0a285df94246400bafdd0e8490e60349"
format_stamp: "Formatted at 2026-08-11 10:06:31 on dist-test-slave-1x4g"
server_key: "af70f2183aa32dc03307f5abdc4fe2f2"
server_key_iv: "51a5ec511eaabb4d6d47c06f3e86bab7"
server_key_version: "encryptionkey@0"
I20260811 10:06:31.672343 32591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:31.700723 32591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:31.702754 32591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:31.702965 32591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:31.707175 32591 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43215
I20260811 10:06:31.707214 32669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43215 every 8 connection(s)
I20260811 10:06:31.707634 32591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:31.708657 32670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:31.710973 32670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349: Bootstrap starting.
I20260811 10:06:31.711509 32670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:31.711752 32670 log.cc:824] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:31.712421 32670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349: No bootstrap required, opened a new log
I20260811 10:06:31.714069 32670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285df94246400bafdd0e8490e60349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43215 } }
I20260811 10:06:31.714205 32670 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:31.714226 32670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a285df94246400bafdd0e8490e60349, State: Initialized, Role: FOLLOWER
I20260811 10:06:31.714366 32670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285df94246400bafdd0e8490e60349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43215 } }
I20260811 10:06:31.714447 32670 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:31.714470 32670 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:31.714496 32670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:31.714929 32670 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285df94246400bafdd0e8490e60349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43215 } }
I20260811 10:06:31.715010 32670 leader_election.cc:302] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a285df94246400bafdd0e8490e60349; no voters:
I20260811 10:06:31.715121 32670 leader_election.cc:288] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:31.715183 32674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:31.715348 32674 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [term 1 LEADER]: Becoming Leader. State: Replica: 0a285df94246400bafdd0e8490e60349, State: Running, Role: LEADER
I20260811 10:06:31.715373 32670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:31.715452 32674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285df94246400bafdd0e8490e60349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43215 } }
I20260811 10:06:31.715826 32677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a285df94246400bafdd0e8490e60349. Latest consensus state: current_term: 1 leader_uuid: "0a285df94246400bafdd0e8490e60349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285df94246400bafdd0e8490e60349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43215 } } }
I20260811 10:06:31.715914 32677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:31.715951 32675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a285df94246400bafdd0e8490e60349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a285df94246400bafdd0e8490e60349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43215 } } }
I20260811 10:06:31.716019 32675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:31.716691 32683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:31.717255 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 32591
I20260811 10:06:31.717301 32683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:31.717386 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:31.717615 9727 external_mini_cluster.cc:1428] Setting key 855ad832108907ea192ddf81f665c8d8
I20260811 10:06:31.719029 32683 catalog_manager.cc:1347] Generated new cluster ID: 2643c24789a540b2b2b7b4ce36a56362
I20260811 10:06:31.719087 32683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:06:31 dist-test-slave-1x4g krb5kdc[32577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 10:06:31.730297 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:31.718065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59097 (local address 127.0.0.1:43215)
0811 10:06:31.718484 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:31.718494 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:31.718531 (+ 37us) server_negotiation.cc:407] Connection header received
0811 10:06:31.718662 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:31.718667 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:31.718707 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:31.718836 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:31.719628 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:31.721184 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:31.722304 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:31.722956 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:31.723070 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:31.726149 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:31.726153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:31.726153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:31.726166 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:31.728129 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:31.728538 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:31.728541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:31.728541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:31.728687 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:31.728936 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:31.728937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:31.728937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:31.729251 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:31.729407 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:31.729926 (+ 519us) server_negotiation.cc:299] Negotiation successful
0811 10:06:31.730064 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":68,"threads_started":1}
I20260811 10:06:31.731560 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:31.736627 32683 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:31.737375 32683 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:31.739686 32683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a285df94246400bafdd0e8490e60349: Generated new TSK 0
I20260811 10:06:31.739871 32683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:31.740087 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:31.733041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46085 (local address 127.0.0.1:43215)
0811 10:06:31.733081 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:31.733083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:31.733247 (+ 164us) server_negotiation.cc:407] Connection header received
0811 10:06:31.733279 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:31.733280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:31.733292 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:31.733356 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:31.733911 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:31.734668 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:31.735689 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:31.736020 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:31.736089 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:31.737419 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:31.737420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:31.737421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:31.737428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:31.738842 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:31.739208 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:31.739209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:31.739210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:31.739267 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:31.739476 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:31.739478 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:31.739478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:31.739619 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:31.739719 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:31.739912 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 10:06:31.740004 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:06:31.742378 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 32591
2026-08-11T10:06:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1383 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:31 dist-test-slave-1x4g krb5kdc[32708](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:31 dist-test-slave-1x4g krb5kdc[32708](info): set up 2 sockets
Aug 11 10:06:31 dist-test-slave-1x4g krb5kdc[32708](info): commencing operation
krb5kdc: starting...
W20260811 10:06:32.822997 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:32 dist-test-slave-1x4g krb5kdc[32708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:32.951242 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45459
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:33.033648 32723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:33.033869 32723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:33.033908 32723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:33.035027 32723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:33.035091 32723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:33.035116 32723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:33.035147 32723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:33.035172 32723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:33.036687 32723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:33.036991 32723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:33.037222 32723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:33.041985 32729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:33.041997 32730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:33.042001 32732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:33.042237 32723 server_base.cc:1034] running on GCE node
I20260811 10:06:33.042514 32723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:33.042799 32723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:33.043967 32723 hybrid_clock.cc:648] HybridClock initialized: now 1786442793043960 us; error 36 us; skew 500 ppm
Aug 11 10:06:33 dist-test-slave-1x4g krb5kdc[32708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442793, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:33.046561 32723 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:33.047026 32723 webserver.cc:460] Webserver started at http://127.0.0.1:36391/ using document root <none> and password file <none>
I20260811 10:06:33.047304 32723 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:33.047377 32723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:33.047518 32723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:33.048563 32723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "1ebea8017da54c80aa39f99ba3585d29"
format_stamp: "Formatted at 2026-08-11 10:06:33 on dist-test-slave-1x4g"
server_key: "a94f4af608e8a66a3baaa3a9fcabfbc5"
server_key_iv: "ed67e6305f544b06110a33a8977c6ac3"
server_key_version: "encryptionkey@0"
I20260811 10:06:33.048955 32723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "1ebea8017da54c80aa39f99ba3585d29"
format_stamp: "Formatted at 2026-08-11 10:06:33 on dist-test-slave-1x4g"
server_key: "a94f4af608e8a66a3baaa3a9fcabfbc5"
server_key_iv: "ed67e6305f544b06110a33a8977c6ac3"
server_key_version: "encryptionkey@0"
I20260811 10:06:33.050297 32723 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:33.051046 32740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:33.051236 32723 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:33.051343 32723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "1ebea8017da54c80aa39f99ba3585d29"
format_stamp: "Formatted at 2026-08-11 10:06:33 on dist-test-slave-1x4g"
server_key: "a94f4af608e8a66a3baaa3a9fcabfbc5"
server_key_iv: "ed67e6305f544b06110a33a8977c6ac3"
server_key_version: "encryptionkey@0"
I20260811 10:06:33.051415 32723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:33.059546 32723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:33.061250 32723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:33.061398 32723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:33.065402 32723 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45459
I20260811 10:06:33.065449 327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45459 every 8 connection(s)
I20260811 10:06:33.065793 32723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:33.066569 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 32723
I20260811 10:06:33.066699 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:33.066829 328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:33.066888 9727 external_mini_cluster.cc:1428] Setting key 836560dc22c28c4011808983d681d1ef
I20260811 10:06:33.069990 328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29: Bootstrap starting.
I20260811 10:06:33.070617 328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:33.070933 328 log.cc:824] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:33.071656 328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29: No bootstrap required, opened a new log
I20260811 10:06:33.072336 331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:33.067452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54829 (local address 127.0.0.1:45459)
0811 10:06:33.067667 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:33.067677 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:33.067713 (+ 36us) server_negotiation.cc:407] Connection header received
0811 10:06:33.068169 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:33.068179 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:33.068244 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:33.068399 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:33.068598 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:33.069534 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:33.070386 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:33.070845 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:33.070987 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:33.071689 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:33.071694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:33.071694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:33.071911 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:33.071941 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:33.071951 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:33.072017 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:33.072093 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 10:06:33.072155 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":88,"threads_started":1}
I20260811 10:06:33.073444 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:33.073874 328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebea8017da54c80aa39f99ba3585d29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } }
I20260811 10:06:33.074028 328 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:33.074082 328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebea8017da54c80aa39f99ba3585d29, State: Initialized, Role: FOLLOWER
I20260811 10:06:33.074203 328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebea8017da54c80aa39f99ba3585d29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } }
I20260811 10:06:33.074282 328 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:33.074327 328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:33.074388 328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:33.075160 328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebea8017da54c80aa39f99ba3585d29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } }
I20260811 10:06:33.075277 328 leader_election.cc:302] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ebea8017da54c80aa39f99ba3585d29; no voters:
I20260811 10:06:33.075450 328 leader_election.cc:288] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:33.075488 339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:33.075641 339 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [term 1 LEADER]: Becoming Leader. State: Replica: 1ebea8017da54c80aa39f99ba3585d29, State: Running, Role: LEADER
I20260811 10:06:33.075717 328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:33.075736 339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebea8017da54c80aa39f99ba3585d29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } }
I20260811 10:06:33.076031 339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ebea8017da54c80aa39f99ba3585d29. Latest consensus state: current_term: 1 leader_uuid: "1ebea8017da54c80aa39f99ba3585d29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebea8017da54c80aa39f99ba3585d29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } } }
I20260811 10:06:33.076125 339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:33.076042 340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ebea8017da54c80aa39f99ba3585d29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebea8017da54c80aa39f99ba3585d29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } } }
I20260811 10:06:33.076283 340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29 [sys.catalog]: This master's current role is: LEADER
W20260811 10:06:33.077642 356 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:33.077731 356 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:33.077800 344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:33.077965 344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:33.078312 331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:33.074879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55777 (local address 127.0.0.1:45459)
0811 10:06:33.074916 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:33.074917 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:33.075050 (+ 133us) server_negotiation.cc:407] Connection header received
0811 10:06:33.075114 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:33.075115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:33.075126 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:33.075182 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:33.075295 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:33.075966 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:33.077061 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:33.077374 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:33.077460 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:33.078076 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:33.078077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:33.078078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:33.078082 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:33.078095 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:33.078099 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:33.078154 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:33.078213 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 10:06:33.078233 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:06:33.079455 344 catalog_manager.cc:1347] Generated new cluster ID: 246c3899dfab4bc7ac41bbe855a0fd3f
I20260811 10:06:33.079510 344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:33.091490 344 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:33.091964 344 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:33.099269 344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ebea8017da54c80aa39f99ba3585d29: Generated new TSK 0
I20260811 10:06:33.099460 344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:33.105751 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 32723
2026-08-11T10:06:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1362 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:33 dist-test-slave-1x4g krb5kdc[362](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:33 dist-test-slave-1x4g krb5kdc[362](info): set up 2 sockets
Aug 11 10:06:33 dist-test-slave-1x4g krb5kdc[362](info): commencing operation
krb5kdc: starting...
W20260811 10:06:34.188577 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:34 dist-test-slave-1x4g krb5kdc[362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:34.320057 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45551
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:34.401388 376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:34.401580 376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:34.401602 376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:34.402798 376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:34.402843 376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:34.402858 376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:34.402870 376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:34.402925 376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:34.404429 376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:34.404685 376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:34.404944 376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:34.409660 383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:34.409662 381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:34.409708 385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:34.409886 376 server_base.cc:1034] running on GCE node
I20260811 10:06:34.410112 376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:34.410399 376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:34.411542 376 hybrid_clock.cc:648] HybridClock initialized: now 1786442794411529 us; error 28 us; skew 500 ppm
Aug 11 10:06:34 dist-test-slave-1x4g krb5kdc[362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442794, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:34.413980 376 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:34.414459 376 webserver.cc:460] Webserver started at http://127.0.0.1:42861/ using document root <none> and password file <none>
I20260811 10:06:34.414695 376 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:34.414739 376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:34.414878 376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:34.415885 376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "cd98c9c5aa5846fc93155932e3f091e9"
format_stamp: "Formatted at 2026-08-11 10:06:34 on dist-test-slave-1x4g"
server_key: "7591d9b64db8b25144b69f24ef7c222e"
server_key_iv: "74d39c054f49143c3c156e119e84c76c"
server_key_version: "encryptionkey@0"
I20260811 10:06:34.416262 376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "cd98c9c5aa5846fc93155932e3f091e9"
format_stamp: "Formatted at 2026-08-11 10:06:34 on dist-test-slave-1x4g"
server_key: "7591d9b64db8b25144b69f24ef7c222e"
server_key_iv: "74d39c054f49143c3c156e119e84c76c"
server_key_version: "encryptionkey@0"
I20260811 10:06:34.417688 376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:34.418399 393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:34.418624 376 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:34.418742 376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "cd98c9c5aa5846fc93155932e3f091e9"
format_stamp: "Formatted at 2026-08-11 10:06:34 on dist-test-slave-1x4g"
server_key: "7591d9b64db8b25144b69f24ef7c222e"
server_key_iv: "74d39c054f49143c3c156e119e84c76c"
server_key_version: "encryptionkey@0"
I20260811 10:06:34.418817 376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:34.422142 376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:34.423976 376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:34.424129 376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:34.428309 376 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45551
I20260811 10:06:34.428340 451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45551 every 8 connection(s)
I20260811 10:06:34.428659 376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:34.429694 452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:34.431799 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9: Bootstrap starting.
I20260811 10:06:34.432298 452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:34.432570 452 log.cc:824] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:34.433264 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9: No bootstrap required, opened a new log
I20260811 10:06:34.434736 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 376
I20260811 10:06:34.434875 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:34.435055 9727 external_mini_cluster.cc:1428] Setting key 5fbbf39c6792987b6e9cb50ec5560804
I20260811 10:06:34.434815 452 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd98c9c5aa5846fc93155932e3f091e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45551 } }
I20260811 10:06:34.435105 452 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:34.435199 452 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd98c9c5aa5846fc93155932e3f091e9, State: Initialized, Role: FOLLOWER
I20260811 10:06:34.435348 452 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd98c9c5aa5846fc93155932e3f091e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45551 } }
I20260811 10:06:34.435665 452 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:34.435750 452 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:34.435811 452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:34.436959 452 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd98c9c5aa5846fc93155932e3f091e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45551 } }
I20260811 10:06:34.437065 452 leader_election.cc:302] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd98c9c5aa5846fc93155932e3f091e9; no voters:
I20260811 10:06:34.437137 456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:34.435489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50633 (local address 127.0.0.1:45551)
0811 10:06:34.435681 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:34.435690 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:34.435747 (+ 57us) server_negotiation.cc:407] Connection header received
0811 10:06:34.435879 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:34.435887 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:34.435916 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:34.436063 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:34.436715 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:34.436719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:34.436719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:34.436723 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:34.436767 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:34.436810 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:34.436887 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:34.436926 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 10:06:34.436967 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260811 10:06:34.437408 452 leader_election.cc:288] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:34.437469 457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:34.437656 457 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [term 1 LEADER]: Becoming Leader. State: Replica: cd98c9c5aa5846fc93155932e3f091e9, State: Running, Role: LEADER
I20260811 10:06:34.437664 452 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:34.437847 457 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd98c9c5aa5846fc93155932e3f091e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45551 } }
I20260811 10:06:34.437997 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:34.439066 459 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd98c9c5aa5846fc93155932e3f091e9. Latest consensus state: current_term: 1 leader_uuid: "cd98c9c5aa5846fc93155932e3f091e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd98c9c5aa5846fc93155932e3f091e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45551 } } }
I20260811 10:06:34.439170 459 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:34.439251 458 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd98c9c5aa5846fc93155932e3f091e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd98c9c5aa5846fc93155932e3f091e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45551 } } }
I20260811 10:06:34.439586 458 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9 [sys.catalog]: This master's current role is: LEADER
W20260811 10:06:34.440147 475 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:34.440218 475 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:34.440318 479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:34.440495 479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:34.441207 456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:34.439671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46131 (local address 127.0.0.1:45551)
0811 10:06:34.439704 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:34.439707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:34.439940 (+ 233us) server_negotiation.cc:407] Connection header received
0811 10:06:34.439963 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:34.439964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:34.439971 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:34.440020 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:34.440987 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:34.440988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:34.440988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:34.440993 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:34.441005 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:34.441009 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:34.441061 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:34.441144 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 10:06:34.441157 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 10:06:34.442060 479 catalog_manager.cc:1347] Generated new cluster ID: 2de6cb989d1341409eb900b206120ccc
I20260811 10:06:34.442116 479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:34.449435 479 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:34.449581 479 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:34.453725 479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd98c9c5aa5846fc93155932e3f091e9: Generated new TSK 0
I20260811 10:06:34.453887 479 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:34.457610 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 376
2026-08-11T10:06:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1347 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:34 dist-test-slave-1x4g krb5kdc[485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:34 dist-test-slave-1x4g krb5kdc[485](info): set up 2 sockets
Aug 11 10:06:34 dist-test-slave-1x4g krb5kdc[485](info): commencing operation
krb5kdc: starting...
W20260811 10:06:35.533921 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:35 dist-test-slave-1x4g krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:35.657912 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45429
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:35.738873 500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:35.739092 500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:35.739114 500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:35.740249 500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:35.740305 500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:35.740319 500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:35.740370 500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:35.740387 500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:35.741817 500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:35.742074 500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:35.742297 500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:35.747025 505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:35.747004 506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:35.747035 500 server_base.cc:1034] running on GCE node
W20260811 10:06:35.747015 508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:35.747612 500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:35.747907 500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:35.749045 500 hybrid_clock.cc:648] HybridClock initialized: now 1786442795749040 us; error 32 us; skew 500 ppm
Aug 11 10:06:35 dist-test-slave-1x4g krb5kdc[485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442795, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:35.757122 500 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:35.757555 500 webserver.cc:460] Webserver started at http://127.0.0.1:45117/ using document root <none> and password file <none>
I20260811 10:06:35.757779 500 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:35.757825 500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:35.757995 500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:35.759029 500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "50d95f3e3e104e80968e63ecdc071684"
format_stamp: "Formatted at 2026-08-11 10:06:35 on dist-test-slave-1x4g"
server_key: "f6404cba69186283c4558ae9195d7d55"
server_key_iv: "6220ae187b57e99f72b5eed32829c591"
server_key_version: "encryptionkey@0"
I20260811 10:06:35.759389 500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "50d95f3e3e104e80968e63ecdc071684"
format_stamp: "Formatted at 2026-08-11 10:06:35 on dist-test-slave-1x4g"
server_key: "f6404cba69186283c4558ae9195d7d55"
server_key_iv: "6220ae187b57e99f72b5eed32829c591"
server_key_version: "encryptionkey@0"
I20260811 10:06:35.760690 500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:06:35.761439 516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:35.761634 500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:35.761727 500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "50d95f3e3e104e80968e63ecdc071684"
format_stamp: "Formatted at 2026-08-11 10:06:35 on dist-test-slave-1x4g"
server_key: "f6404cba69186283c4558ae9195d7d55"
server_key_iv: "6220ae187b57e99f72b5eed32829c591"
server_key_version: "encryptionkey@0"
I20260811 10:06:35.761801 500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:35.782959 500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:35.785368 500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:35.785486 500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:35.789489 500 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45429
I20260811 10:06:35.789520 571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45429 every 8 connection(s)
I20260811 10:06:35.789865 500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:35.790889 572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:35.792716 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 500
I20260811 10:06:35.792872 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:35.793087 9727 external_mini_cluster.cc:1428] Setting key dc6a6690433248a9ee7fa0c33377577f
I20260811 10:06:35.793416 572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684: Bootstrap starting.
I20260811 10:06:35.794236 572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:35.794582 572 log.cc:824] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:35.795395 572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684: No bootstrap required, opened a new log
I20260811 10:06:35.797297 572 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d95f3e3e104e80968e63ecdc071684" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45429 } }
I20260811 10:06:35.797435 572 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:35.797458 572 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d95f3e3e104e80968e63ecdc071684, State: Initialized, Role: FOLLOWER
I20260811 10:06:35.797603 572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d95f3e3e104e80968e63ecdc071684" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45429 } }
I20260811 10:06:35.797669 572 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:35.797691 572 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:35.797761 572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:35.798313 572 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d95f3e3e104e80968e63ecdc071684" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45429 } }
I20260811 10:06:35.798431 572 leader_election.cc:302] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50d95f3e3e104e80968e63ecdc071684; no voters:
I20260811 10:06:35.798651 572 leader_election.cc:288] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:35.798677 578 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:35.798799 578 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [term 1 LEADER]: Becoming Leader. State: Replica: 50d95f3e3e104e80968e63ecdc071684, State: Running, Role: LEADER
I20260811 10:06:35.798929 572 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:35.798954 578 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d95f3e3e104e80968e63ecdc071684" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45429 } }
I20260811 10:06:35.799721 578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50d95f3e3e104e80968e63ecdc071684. Latest consensus state: current_term: 1 leader_uuid: "50d95f3e3e104e80968e63ecdc071684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d95f3e3e104e80968e63ecdc071684" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45429 } } }
I20260811 10:06:35.799808 578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:35.800048 587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:35.800082 579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50d95f3e3e104e80968e63ecdc071684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d95f3e3e104e80968e63ecdc071684" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45429 } } }
I20260811 10:06:35.800194 579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684 [sys.catalog]: This master's current role is: LEADER
Aug 11 10:06:35 dist-test-slave-1x4g krb5kdc[485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 10:06:35.800649 587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:35.802383 587 catalog_manager.cc:1347] Generated new cluster ID: 4348ed7e7dac4ae6b8d1ab5ed1d3cf96
I20260811 10:06:35.802456 587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:35.805006 576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:35.793709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:36281 (local address 127.0.0.1:45429)
0811 10:06:35.793911 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:35.793922 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:35.793962 (+ 40us) server_negotiation.cc:407] Connection header received
0811 10:06:35.794626 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:35.794635 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:35.794699 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:35.794858 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:35.795604 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:35.796499 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:35.797329 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:35.797942 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:35.798069 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:35.801001 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:35.801006 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:35.801006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:35.801020 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:35.803100 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:35.803526 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:35.803529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:35.803530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:35.803625 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:35.803819 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:35.803820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:35.803820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:35.804085 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:35.804246 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:35.804659 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 10:06:35.804766 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":84,"threads_started":1}
I20260811 10:06:35.806483 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:35.812032 587 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:35.812795 587 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:35.815501 576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:35.808044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:57159 (local address 127.0.0.1:45429)
0811 10:06:35.808076 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:35.808078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:35.808345 (+ 267us) server_negotiation.cc:407] Connection header received
0811 10:06:35.808403 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:35.808404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:35.808413 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:35.808471 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:35.809142 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:35.809882 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:35.810956 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:35.811263 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:35.811330 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:35.812771 (+ 1441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:35.812824 (+ 53us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:35.812825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:35.812832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:35.814301 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:35.814693 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:35.814694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:35.814694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:35.814739 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:35.814930 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:35.814930 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:35.814931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:35.815029 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:35.815110 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:35.815353 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 10:06:35.815411 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 10:06:35.823333 587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50d95f3e3e104e80968e63ecdc071684: Generated new TSK 0
I20260811 10:06:35.823518 587 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:35.826972 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 500
W20260811 10:06:35.838663 483 connection.cc:535] client connection to 127.0.0.1:45429 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45429): Connection reset by peer (error 104)
2026-08-11T10:06:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1374 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:35 dist-test-slave-1x4g krb5kdc[607](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:35 dist-test-slave-1x4g krb5kdc[607](info): set up 2 sockets
Aug 11 10:06:35 dist-test-slave-1x4g krb5kdc[607](info): commencing operation
krb5kdc: starting...
W20260811 10:06:36.913918 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:36 dist-test-slave-1x4g krb5kdc[607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:37.036064 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42545
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:37.116426 623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:37.116688 623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:37.116727 623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:37.117942 623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:37.118013 623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:37.118038 623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:37.118065 623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:37.118086 623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:37.119541 623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:37.119844 623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:37.120078 623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:37.124701 632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:37.124712 630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:37.124688 629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:37.125003 623 server_base.cc:1034] running on GCE node
I20260811 10:06:37.125232 623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:37.125550 623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:37.126721 623 hybrid_clock.cc:648] HybridClock initialized: now 1786442797126703 us; error 30 us; skew 500 ppm
Aug 11 10:06:37 dist-test-slave-1x4g krb5kdc[607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442797, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:37.129271 623 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:37.129776 623 webserver.cc:460] Webserver started at http://127.0.0.1:37347/ using document root <none> and password file <none>
I20260811 10:06:37.130147 623 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:37.130229 623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:37.130385 623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:37.131460 623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "85869355c72a4ee39aa7e360bbad9fc6"
format_stamp: "Formatted at 2026-08-11 10:06:37 on dist-test-slave-1x4g"
server_key: "33703096c378daca5d1f1975233b706e"
server_key_iv: "3f1ad38e5c10ce461128c8950a2efe88"
server_key_version: "encryptionkey@0"
I20260811 10:06:37.131834 623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "85869355c72a4ee39aa7e360bbad9fc6"
format_stamp: "Formatted at 2026-08-11 10:06:37 on dist-test-slave-1x4g"
server_key: "33703096c378daca5d1f1975233b706e"
server_key_iv: "3f1ad38e5c10ce461128c8950a2efe88"
server_key_version: "encryptionkey@0"
I20260811 10:06:37.133252 623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:37.133991 639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:37.134162 623 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:37.134294 623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "85869355c72a4ee39aa7e360bbad9fc6"
format_stamp: "Formatted at 2026-08-11 10:06:37 on dist-test-slave-1x4g"
server_key: "33703096c378daca5d1f1975233b706e"
server_key_iv: "3f1ad38e5c10ce461128c8950a2efe88"
server_key_version: "encryptionkey@0"
I20260811 10:06:37.134377 623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:37.143792 623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:37.145694 623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:37.145855 623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:37.150172 623 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42545
I20260811 10:06:37.150221 695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42545 every 8 connection(s)
I20260811 10:06:37.150588 623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:37.151594 696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:37.154031 696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6: Bootstrap starting.
I20260811 10:06:37.154627 696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:37.154913 696 log.cc:824] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:37.155584 696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6: No bootstrap required, opened a new log
I20260811 10:06:37.157272 696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85869355c72a4ee39aa7e360bbad9fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } }
I20260811 10:06:37.157426 696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:37.157449 696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85869355c72a4ee39aa7e360bbad9fc6, State: Initialized, Role: FOLLOWER
I20260811 10:06:37.157615 696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85869355c72a4ee39aa7e360bbad9fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } }
I20260811 10:06:37.157680 696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:37.157701 696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:37.157768 696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:37.158303 696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85869355c72a4ee39aa7e360bbad9fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } }
I20260811 10:06:37.158438 696 leader_election.cc:302] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85869355c72a4ee39aa7e360bbad9fc6; no voters:
I20260811 10:06:37.158607 696 leader_election.cc:288] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:37.158656 700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:37.158838 700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [term 1 LEADER]: Becoming Leader. State: Replica: 85869355c72a4ee39aa7e360bbad9fc6, State: Running, Role: LEADER
I20260811 10:06:37.158869 696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:37.158998 700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85869355c72a4ee39aa7e360bbad9fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } }
I20260811 10:06:37.159397 702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85869355c72a4ee39aa7e360bbad9fc6. Latest consensus state: current_term: 1 leader_uuid: "85869355c72a4ee39aa7e360bbad9fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85869355c72a4ee39aa7e360bbad9fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } } }
I20260811 10:06:37.159533 701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85869355c72a4ee39aa7e360bbad9fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85869355c72a4ee39aa7e360bbad9fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42545 } } }
I20260811 10:06:37.159605 701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:37.159540 702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:37.160001 710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:37.160554 710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:37.160923 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 623
I20260811 10:06:37.161072 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:37.161267 9727 external_mini_cluster.cc:1428] Setting key 195a1abce952f0e07735335f09115a44
I20260811 10:06:37.162199 710 catalog_manager.cc:1347] Generated new cluster ID: 75e952cb57d3486396be4359f7a35096
I20260811 10:06:37.162247 710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:37.167989 721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:37.162404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:53061 (local address 127.0.0.1:42545)
0811 10:06:37.162546 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:37.162555 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:37.162585 (+ 30us) server_negotiation.cc:407] Connection header received
0811 10:06:37.162702 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:37.162709 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:37.162769 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:37.162897 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:37.163165 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:37.164542 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:37.165722 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:37.166327 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:37.166427 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:37.167192 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:37.167196 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:37.167196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:37.167412 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:37.167448 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:37.167461 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:37.167540 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:37.167763 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 10:06:37.167791 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":59,"threads_started":1}
I20260811 10:06:37.169005 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:37.173974 721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:37.170629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:48129 (local address 127.0.0.1:42545)
0811 10:06:37.170671 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:37.170673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:37.170681 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:06:37.170701 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:37.170701 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:37.170711 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:37.170777 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:37.170885 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:37.171619 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:37.172614 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:37.172984 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:37.173049 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:37.173728 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:37.173730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:37.173730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:37.173734 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:37.173750 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:37.173754 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:37.173815 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:37.173888 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 10:06:37.173900 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 10:06:37.187256 710 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:37.187959 710 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:37.198932 710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85869355c72a4ee39aa7e360bbad9fc6: Generated new TSK 0
I20260811 10:06:37.199126 710 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:37.204524 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 623
W20260811 10:06:37.212095 605 connection.cc:535] client connection to 127.0.0.1:42545 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42545): Connection reset by peer (error 104)
2026-08-11T10:06:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1373 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:37 dist-test-slave-1x4g krb5kdc[731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:37 dist-test-slave-1x4g krb5kdc[731](info): set up 2 sockets
Aug 11 10:06:37 dist-test-slave-1x4g krb5kdc[731](info): commencing operation
krb5kdc: starting...
W20260811 10:06:38.273443 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:38 dist-test-slave-1x4g krb5kdc[731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:38.391510 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44525
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:38.471068 745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:38.471267 745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:38.471289 745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:38.472323 745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:38.472361 745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:38.472375 745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:38.472388 745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:38.472400 745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:38.473855 745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:38.474041 745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:38.474201 745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:38.478909 753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:38.478919 751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:38.478928 750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:38.479244 745 server_base.cc:1034] running on GCE node
I20260811 10:06:38.479488 745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:38.479763 745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:38.480921 745 hybrid_clock.cc:648] HybridClock initialized: now 1786442798480905 us; error 27 us; skew 500 ppm
Aug 11 10:06:38 dist-test-slave-1x4g krb5kdc[731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442798, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:38.483208 745 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:38.483639 745 webserver.cc:460] Webserver started at http://127.0.0.1:41293/ using document root <none> and password file <none>
I20260811 10:06:38.483861 745 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:38.483927 745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:38.484077 745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:38.485109 745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "e2f986eda2be43cb947375e47421b659"
format_stamp: "Formatted at 2026-08-11 10:06:38 on dist-test-slave-1x4g"
server_key: "f83407db5bf1ff4689f7dfec6e264540"
server_key_iv: "55af9e2d8d41f0d89bf67d2d40ca897f"
server_key_version: "encryptionkey@0"
I20260811 10:06:38.485458 745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "e2f986eda2be43cb947375e47421b659"
format_stamp: "Formatted at 2026-08-11 10:06:38 on dist-test-slave-1x4g"
server_key: "f83407db5bf1ff4689f7dfec6e264540"
server_key_iv: "55af9e2d8d41f0d89bf67d2d40ca897f"
server_key_version: "encryptionkey@0"
I20260811 10:06:38.486835 745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:38.487553 760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:38.487749 745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:38.487854 745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "e2f986eda2be43cb947375e47421b659"
format_stamp: "Formatted at 2026-08-11 10:06:38 on dist-test-slave-1x4g"
server_key: "f83407db5bf1ff4689f7dfec6e264540"
server_key_iv: "55af9e2d8d41f0d89bf67d2d40ca897f"
server_key_version: "encryptionkey@0"
I20260811 10:06:38.487927 745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:38.491196 745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:38.492980 745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:38.493139 745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:38.497061 745 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44525
I20260811 10:06:38.497090 818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44525 every 8 connection(s)
I20260811 10:06:38.497408 745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:38.498361 819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:38.500414 819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659: Bootstrap starting.
I20260811 10:06:38.500990 819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:38.501232 819 log.cc:824] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:38.501842 819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659: No bootstrap required, opened a new log
I20260811 10:06:38.503369 819 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f986eda2be43cb947375e47421b659" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } }
I20260811 10:06:38.503497 819 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:38.503518 819 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2f986eda2be43cb947375e47421b659, State: Initialized, Role: FOLLOWER
I20260811 10:06:38.503647 819 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f986eda2be43cb947375e47421b659" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } }
I20260811 10:06:38.503728 819 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:38.503750 819 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:38.503778 819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:38.504268 819 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f986eda2be43cb947375e47421b659" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } }
I20260811 10:06:38.504348 819 leader_election.cc:302] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2f986eda2be43cb947375e47421b659; no voters:
I20260811 10:06:38.504462 819 leader_election.cc:288] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:38.504524 822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:38.504685 822 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [term 1 LEADER]: Becoming Leader. State: Replica: e2f986eda2be43cb947375e47421b659, State: Running, Role: LEADER
I20260811 10:06:38.504758 819 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:38.504837 822 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f986eda2be43cb947375e47421b659" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } }
I20260811 10:06:38.505244 826 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2f986eda2be43cb947375e47421b659. Latest consensus state: current_term: 1 leader_uuid: "e2f986eda2be43cb947375e47421b659" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f986eda2be43cb947375e47421b659" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } } }
I20260811 10:06:38.505236 823 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2f986eda2be43cb947375e47421b659" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2f986eda2be43cb947375e47421b659" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } } }
I20260811 10:06:38.505338 826 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:38.505343 823 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:38.505535 828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:38.506093 828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:38.506316 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 745
I20260811 10:06:38.506488 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:38.506708 9727 external_mini_cluster.cc:1428] Setting key d21e2df171dbd56ca3ddf5c6440c6f6a
I20260811 10:06:38.507827 828 catalog_manager.cc:1347] Generated new cluster ID: 75100c5d1afa47d586dbf3416f088d58
I20260811 10:06:38.507889 828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:38.509527 850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:38.507219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:55191 (local address 127.0.0.1:44525)
0811 10:06:38.507921 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:38.507930 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:38.507978 (+ 48us) server_negotiation.cc:407] Connection header received
0811 10:06:38.508100 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:38.508107 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:38.508135 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:38.508522 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:38.508982 (+ 460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:38.508985 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:38.508985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:38.508988 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:38.509021 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:38.509034 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:38.509280 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:38.509306 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 10:06:38.509345 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":73,"threads_started":1}
I20260811 10:06:38.510327 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:38.513051 850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:38.511908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:42429 (local address 127.0.0.1:44525)
0811 10:06:38.511937 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:38.511938 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:38.512067 (+ 129us) server_negotiation.cc:407] Connection header received
0811 10:06:38.512114 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:38.512114 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:38.512118 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:38.512170 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:38.512748 (+ 578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:38.512748 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:38.512749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:38.512752 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:38.512766 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:38.512770 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:38.512898 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:38.512983 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 10:06:38.512995 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 10:06:38.521876 828 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:38.522022 828 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:38.526350 828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2f986eda2be43cb947375e47421b659: Generated new TSK 0
I20260811 10:06:38.526508 828 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:38.533512 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 745
2026-08-11T10:06:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1329 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:38 dist-test-slave-1x4g krb5kdc[859](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:38 dist-test-slave-1x4g krb5kdc[859](info): set up 2 sockets
Aug 11 10:06:38 dist-test-slave-1x4g krb5kdc[859](info): commencing operation
krb5kdc: starting...
W20260811 10:06:39.598544 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:39 dist-test-slave-1x4g krb5kdc[859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:39.723929 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43977
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:39.804740 872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:39.804986 872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:39.805023 872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:39.806170 872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:39.806237 872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:39.806260 872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:39.806281 872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:39.806310 872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:39.807731 872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43977
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:39.808008 872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:39.808254 872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:39.812959 878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:39.813019 872 server_base.cc:1034] running on GCE node
W20260811 10:06:39.812964 877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:39.812950 880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:39.813413 872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:39.813733 872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:39.814898 872 hybrid_clock.cc:648] HybridClock initialized: now 1786442799814893 us; error 33 us; skew 500 ppm
Aug 11 10:06:39 dist-test-slave-1x4g krb5kdc[859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442799, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:39.817421 872 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:39.817863 872 webserver.cc:460] Webserver started at http://127.0.0.1:42021/ using document root <none> and password file <none>
I20260811 10:06:39.818123 872 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:39.818194 872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:39.818356 872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:39.819409 872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "88107e7ab08d435b89974320a650925f"
format_stamp: "Formatted at 2026-08-11 10:06:39 on dist-test-slave-1x4g"
server_key: "9a649c2302f045a5e4f591fcfd1893e0"
server_key_iv: "4b006cde92240cd59a14be2a1b872432"
server_key_version: "encryptionkey@0"
I20260811 10:06:39.819777 872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "88107e7ab08d435b89974320a650925f"
format_stamp: "Formatted at 2026-08-11 10:06:39 on dist-test-slave-1x4g"
server_key: "9a649c2302f045a5e4f591fcfd1893e0"
server_key_iv: "4b006cde92240cd59a14be2a1b872432"
server_key_version: "encryptionkey@0"
I20260811 10:06:39.821193 872 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:39.821862 888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:39.822073 872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:39.822171 872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "88107e7ab08d435b89974320a650925f"
format_stamp: "Formatted at 2026-08-11 10:06:39 on dist-test-slave-1x4g"
server_key: "9a649c2302f045a5e4f591fcfd1893e0"
server_key_iv: "4b006cde92240cd59a14be2a1b872432"
server_key_version: "encryptionkey@0"
I20260811 10:06:39.822224 872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:39.842831 872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:39.845121 872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:39.845227 872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:39.849085 872 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43977
I20260811 10:06:39.849148 947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43977 every 8 connection(s)
I20260811 10:06:39.849502 872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:39.850570 948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:39.852943 948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f: Bootstrap starting.
I20260811 10:06:39.853525 948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:39.853830 948 log.cc:824] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:39.854532 948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f: No bootstrap required, opened a new log
I20260811 10:06:39.856130 948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88107e7ab08d435b89974320a650925f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } }
I20260811 10:06:39.856309 948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:39.856365 948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88107e7ab08d435b89974320a650925f, State: Initialized, Role: FOLLOWER
I20260811 10:06:39.856523 948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88107e7ab08d435b89974320a650925f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } }
I20260811 10:06:39.856606 948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:39.856669 948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:39.856739 948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:39.857295 948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88107e7ab08d435b89974320a650925f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } }
I20260811 10:06:39.857411 948 leader_election.cc:302] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88107e7ab08d435b89974320a650925f; no voters:
I20260811 10:06:39.857580 948 leader_election.cc:288] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:39.857601 951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:39.857764 951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [term 1 LEADER]: Becoming Leader. State: Replica: 88107e7ab08d435b89974320a650925f, State: Running, Role: LEADER
I20260811 10:06:39.857853 948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:39.857939 951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88107e7ab08d435b89974320a650925f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } }
I20260811 10:06:39.858395 953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88107e7ab08d435b89974320a650925f. Latest consensus state: current_term: 1 leader_uuid: "88107e7ab08d435b89974320a650925f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88107e7ab08d435b89974320a650925f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } } }
I20260811 10:06:39.858485 953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:39.858528 952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88107e7ab08d435b89974320a650925f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88107e7ab08d435b89974320a650925f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43977 } } }
I20260811 10:06:39.858618 952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:39.858968 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 872
I20260811 10:06:39.858975 961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:39.859087 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:39.859283 9727 external_mini_cluster.cc:1428] Setting key b04eb60928da6f8fcedfbbd6d732b9ca
I20260811 10:06:39.859552 961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:39.861155 961 catalog_manager.cc:1347] Generated new cluster ID: d067ff9d59ec49789e04f85609a23775
I20260811 10:06:39.861207 961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:06:39 dist-test-slave-1x4g krb5kdc[859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 10:06:39.870957 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:39.859895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:52657 (local address 127.0.0.1:43977)
0811 10:06:39.860123 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:39.860132 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:39.860344 (+ 212us) server_negotiation.cc:407] Connection header received
0811 10:06:39.860498 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:39.860504 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:39.860595 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:39.860721 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:39.861480 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:39.862865 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:39.863893 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:39.864476 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:39.864559 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:39.867253 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:39.867257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:39.867257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:39.867268 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:39.869129 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:39.869538 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:39.869540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:39.869541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:39.869643 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:39.869832 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:39.869832 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:39.869833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:39.870105 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:39.870213 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:39.870636 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 10:06:39.870727 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":82,"threads_started":1}
I20260811 10:06:39.871685 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:39.881075 961 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:39.881697 961 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:39.884208 961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88107e7ab08d435b89974320a650925f: Generated new TSK 0
I20260811 10:06:39.884397 961 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:39.888018 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:39.880730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:41785 (local address 127.0.0.1:43977)
0811 10:06:39.880801 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:39.880803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:39.881168 (+ 365us) server_negotiation.cc:407] Connection header received
0811 10:06:39.881259 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:39.881260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:39.881271 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:39.881344 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:39.882012 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:39.882734 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:39.883729 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:39.884027 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:39.884098 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:39.885510 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:39.885511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:39.885512 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:39.885535 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:39.886880 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:39.887315 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:39.887316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:39.887317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:39.887366 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:39.887603 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:39.887604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:39.887604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:39.887694 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:39.887779 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:39.887918 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 10:06:39.887965 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 10:06:39.889979 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 872
W20260811 10:06:39.897539 856 connection.cc:535] client connection to 127.0.0.1:43977 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43977): Connection reset by peer (error 104)
2026-08-11T10:06:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1355 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:39 dist-test-slave-1x4g krb5kdc[983](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:39 dist-test-slave-1x4g krb5kdc[983](info): set up 2 sockets
Aug 11 10:06:39 dist-test-slave-1x4g krb5kdc[983](info): commencing operation
krb5kdc: starting...
W20260811 10:06:40.970919 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:41 dist-test-slave-1x4g krb5kdc[983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:41.091463 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35485
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:41.170940 998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:41.171164 998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:41.171201 998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:41.172322 998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:41.172412 998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:41.172436 998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:41.172456 998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:41.172497 998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:41.174022 998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35485
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:41.174296 998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:41.174523 998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:41.179232 1005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:41.179278 1007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:41.179240 1004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:41.179548 998 server_base.cc:1034] running on GCE node
I20260811 10:06:41.179782 998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:41.180027 998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:41.181164 998 hybrid_clock.cc:648] HybridClock initialized: now 1786442801181151 us; error 28 us; skew 500 ppm
Aug 11 10:06:41 dist-test-slave-1x4g krb5kdc[983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442801, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:41.188304 998 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:41.188764 998 webserver.cc:460] Webserver started at http://127.0.0.1:43239/ using document root <none> and password file <none>
I20260811 10:06:41.189026 998 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:41.189069 998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:41.189159 998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:41.190135 998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "20373cfe397b4114884aa1687410540a"
format_stamp: "Formatted at 2026-08-11 10:06:41 on dist-test-slave-1x4g"
server_key: "4606cc9bebe9f3ab7c2ee7e2efa86895"
server_key_iv: "bbe8db81b6673bf2d4de6d2f6d5ed31d"
server_key_version: "encryptionkey@0"
I20260811 10:06:41.190454 998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "20373cfe397b4114884aa1687410540a"
format_stamp: "Formatted at 2026-08-11 10:06:41 on dist-test-slave-1x4g"
server_key: "4606cc9bebe9f3ab7c2ee7e2efa86895"
server_key_iv: "bbe8db81b6673bf2d4de6d2f6d5ed31d"
server_key_version: "encryptionkey@0"
I20260811 10:06:41.191670 998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:06:41.192348 1016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:41.192523 998 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:41.192627 998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "20373cfe397b4114884aa1687410540a"
format_stamp: "Formatted at 2026-08-11 10:06:41 on dist-test-slave-1x4g"
server_key: "4606cc9bebe9f3ab7c2ee7e2efa86895"
server_key_iv: "bbe8db81b6673bf2d4de6d2f6d5ed31d"
server_key_version: "encryptionkey@0"
I20260811 10:06:41.192699 998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:41.204259 998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:41.206024 998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:41.206178 998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:41.210307 998 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35485
I20260811 10:06:41.210340 1074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35485 every 8 connection(s)
I20260811 10:06:41.210690 998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:41.211549 1075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:41.213987 1075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a: Bootstrap starting.
I20260811 10:06:41.214609 1075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:41.214895 1075 log.cc:824] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:41.215587 1075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a: No bootstrap required, opened a new log
I20260811 10:06:41.216324 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 998
I20260811 10:06:41.216462 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:41.216699 9727 external_mini_cluster.cc:1428] Setting key 6c2ce6b1c1c3d9815604cdc8c58242bf
I20260811 10:06:41.218004 1075 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20373cfe397b4114884aa1687410540a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35485 } }
I20260811 10:06:41.218154 1075 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:41.218178 1075 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20373cfe397b4114884aa1687410540a, State: Initialized, Role: FOLLOWER
I20260811 10:06:41.218304 1075 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20373cfe397b4114884aa1687410540a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35485 } }
I20260811 10:06:41.218379 1075 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:41.218492 1075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:41.218556 1075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:41.219139 1075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20373cfe397b4114884aa1687410540a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35485 } }
I20260811 10:06:41.219229 1075 leader_election.cc:302] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20373cfe397b4114884aa1687410540a; no voters:
I20260811 10:06:41.219444 1075 leader_election.cc:288] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:41.219496 1080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:41.219630 1080 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [term 1 LEADER]: Becoming Leader. State: Replica: 20373cfe397b4114884aa1687410540a, State: Running, Role: LEADER
I20260811 10:06:41.219702 1075 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:41.219758 1080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20373cfe397b4114884aa1687410540a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35485 } }
I20260811 10:06:41.220278 1082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20373cfe397b4114884aa1687410540a. Latest consensus state: current_term: 1 leader_uuid: "20373cfe397b4114884aa1687410540a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20373cfe397b4114884aa1687410540a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35485 } } }
I20260811 10:06:41.220366 1082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:41.220861 1088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:41.221336 1081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20373cfe397b4114884aa1687410540a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20373cfe397b4114884aa1687410540a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35485 } } }
I20260811 10:06:41.221491 1081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:41.221385 1088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:41.223273 1079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:41.217263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:33271 (local address 127.0.0.1:35485)
0811 10:06:41.217439 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:41.217447 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:41.217472 (+ 25us) server_negotiation.cc:407] Connection header received
0811 10:06:41.218180 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:41.218190 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:41.218264 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:41.218455 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:41.218696 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:41.219833 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:41.221088 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:41.221715 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:41.221846 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:41.222547 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:41.222551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:41.222551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:41.222750 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:41.222789 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:41.222803 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:41.222884 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:41.223036 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 10:06:41.223064 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260811 10:06:41.223796 1088 catalog_manager.cc:1347] Generated new cluster ID: e3d292b3f8f048b9a661c9f533950f03
I20260811 10:06:41.223876 1088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:41.224311 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:41.232074 1079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:41.229132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:48133 (local address 127.0.0.1:35485)
0811 10:06:41.229174 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:41.229176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:41.229324 (+ 148us) server_negotiation.cc:407] Connection header received
0811 10:06:41.229395 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:41.229396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:41.229406 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:41.229469 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:41.229608 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:41.230086 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:41.230807 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:41.231027 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:41.231115 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:41.231831 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:41.231833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:41.231833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:41.231837 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:41.231851 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:41.231855 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:41.231909 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:41.231989 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 10:06:41.231998 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:06:41.244634 1088 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:41.245455 1088 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:41.253494 1088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20373cfe397b4114884aa1687410540a: Generated new TSK 0
I20260811 10:06:41.253691 1088 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:41.262894 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 998
W20260811 10:06:41.270855 981 connection.cc:535] client connection to 127.0.0.1:35485 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35485): Connection reset by peer (error 104)
2026-08-11T10:06:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1373 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:41 dist-test-slave-1x4g krb5kdc[1109](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:41 dist-test-slave-1x4g krb5kdc[1109](info): set up 2 sockets
Aug 11 10:06:41 dist-test-slave-1x4g krb5kdc[1109](info): commencing operation
krb5kdc: starting...
W20260811 10:06:42.330842 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:42 dist-test-slave-1x4g krb5kdc[1109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 10:06:42.453011 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42089
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:42.533396 1125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:42.533591 1125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:42.533613 1125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:42.534683 1125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:42.534720 1125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:42.534734 1125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:42.534746 1125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:42.534758 1125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:42.536152 1125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42089
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:42.536335 1125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:42.536497 1125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:42.541163 1131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:42.541163 1133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:42.541200 1130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:42.541555 1125 server_base.cc:1034] running on GCE node
I20260811 10:06:42.541752 1125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:42.542025 1125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:42.543159 1125 hybrid_clock.cc:648] HybridClock initialized: now 1786442802543153 us; error 29 us; skew 500 ppm
Aug 11 10:06:42 dist-test-slave-1x4g krb5kdc[1109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442802, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:42.545816 1125 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 10:06:42.546260 1125 webserver.cc:460] Webserver started at http://127.0.0.1:32879/ using document root <none> and password file <none>
I20260811 10:06:42.546514 1125 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:42.546561 1125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:42.546705 1125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:42.547729 1125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "7eeff126cfca44e88c16da48f69489ab"
format_stamp: "Formatted at 2026-08-11 10:06:42 on dist-test-slave-1x4g"
server_key: "39134d966b082a1a834a082cdf55e741"
server_key_iv: "ee4440682771206cd47d94b82cc01800"
server_key_version: "encryptionkey@0"
I20260811 10:06:42.548094 1125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "7eeff126cfca44e88c16da48f69489ab"
format_stamp: "Formatted at 2026-08-11 10:06:42 on dist-test-slave-1x4g"
server_key: "39134d966b082a1a834a082cdf55e741"
server_key_iv: "ee4440682771206cd47d94b82cc01800"
server_key_version: "encryptionkey@0"
I20260811 10:06:42.549499 1125 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:06:42.550242 1142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:42.550417 1125 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:42.550521 1125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "7eeff126cfca44e88c16da48f69489ab"
format_stamp: "Formatted at 2026-08-11 10:06:42 on dist-test-slave-1x4g"
server_key: "39134d966b082a1a834a082cdf55e741"
server_key_iv: "ee4440682771206cd47d94b82cc01800"
server_key_version: "encryptionkey@0"
I20260811 10:06:42.550604 1125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:42.554054 1125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:42.556370 1125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:42.556524 1125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:42.560637 1125 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42089
I20260811 10:06:42.560686 1195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42089 every 8 connection(s)
I20260811 10:06:42.561038 1125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:42.561870 1196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:42.563993 1196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab: Bootstrap starting.
I20260811 10:06:42.564525 1196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:42.564754 1196 log.cc:824] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:42.565429 1196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab: No bootstrap required, opened a new log
I20260811 10:06:42.566975 1196 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eeff126cfca44e88c16da48f69489ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42089 } }
I20260811 10:06:42.567117 1196 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:42.567140 1196 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eeff126cfca44e88c16da48f69489ab, State: Initialized, Role: FOLLOWER
I20260811 10:06:42.567297 1196 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eeff126cfca44e88c16da48f69489ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42089 } }
I20260811 10:06:42.567394 1196 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:42.567397 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 1125
I20260811 10:06:42.567427 1196 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:42.567477 1196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:42.567517 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:42.567716 9727 external_mini_cluster.cc:1428] Setting key 133967bc41220030a9602206f57fcd6b
I20260811 10:06:42.568192 1196 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eeff126cfca44e88c16da48f69489ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42089 } }
I20260811 10:06:42.568317 1196 leader_election.cc:302] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7eeff126cfca44e88c16da48f69489ab; no voters:
I20260811 10:06:42.568501 1196 leader_election.cc:288] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:42.568527 1201 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:42.568681 1201 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [term 1 LEADER]: Becoming Leader. State: Replica: 7eeff126cfca44e88c16da48f69489ab, State: Running, Role: LEADER
I20260811 10:06:42.568778 1196 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:42.568856 1201 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eeff126cfca44e88c16da48f69489ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42089 } }
I20260811 10:06:42.569245 1201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7eeff126cfca44e88c16da48f69489ab. Latest consensus state: current_term: 1 leader_uuid: "7eeff126cfca44e88c16da48f69489ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eeff126cfca44e88c16da48f69489ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42089 } } }
I20260811 10:06:42.569343 1201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:42.569633 1202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7eeff126cfca44e88c16da48f69489ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eeff126cfca44e88c16da48f69489ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42089 } } }
I20260811 10:06:42.569723 1202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:42.570204 1210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:42.570412 1200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:42.568217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:40051 (local address 127.0.0.1:42089)
0811 10:06:42.568401 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:42.568410 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:42.568447 (+ 37us) server_negotiation.cc:407] Connection header received
0811 10:06:42.568577 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:42.568585 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:42.568615 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:42.569481 (+ 866us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:42.569827 (+ 346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:42.569830 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:42.569830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:42.569834 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:42.569866 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:42.569885 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:42.570010 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:42.570165 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 10:06:42.570213 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260811 10:06:42.570806 1210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:42.571792 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:42.572465 1210 catalog_manager.cc:1347] Generated new cluster ID: 8e12a71c876b4c82a4a9c44b2b77af48
I20260811 10:06:42.572532 1210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:42.578182 1200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:42.577145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.163:35391 (local address 127.0.0.1:42089)
0811 10:06:42.577183 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:42.577184 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:42.577289 (+ 105us) server_negotiation.cc:407] Connection header received
0811 10:06:42.577319 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:42.577320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:42.577326 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:42.577397 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:42.577946 (+ 549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:42.577948 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:42.577948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:42.577952 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:42.577969 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:42.577974 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:42.578038 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:42.578094 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 10:06:42.578108 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 10:06:42.582835 1210 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:42.582985 1210 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:42.594520 1210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7eeff126cfca44e88c16da48f69489ab: Generated new TSK 0
I20260811 10:06:42.594703 1210 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:42.596081 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 1125
2026-08-11T10:06:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1331 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:42 dist-test-slave-1x4g krb5kdc[1230](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:42 dist-test-slave-1x4g krb5kdc[1230](info): set up 2 sockets
Aug 11 10:06:42 dist-test-slave-1x4g krb5kdc[1230](info): commencing operation
krb5kdc: starting...
W20260811 10:06:43.670915 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:43 dist-test-slave-1x4g krb5kdc[1230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:43.800469 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37973
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:46379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:37973
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:43.885322 1244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:43.885545 1244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:43.885567 1244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:43.886709 1244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:43.886756 1244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:43.886770 1244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:43.886782 1244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:43.886850 1244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:43.888348 1244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:46379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:37973
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:37973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:43.888613 1244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:43.888875 1244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:43.893677 1253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:43.893713 1251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:43.893683 1250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:43.893896 1244 server_base.cc:1034] running on GCE node
I20260811 10:06:43.894130 1244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:43.894428 1244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:43.895574 1244 hybrid_clock.cc:648] HybridClock initialized: now 1786442803895554 us; error 34 us; skew 500 ppm
Aug 11 10:06:43 dist-test-slave-1x4g krb5kdc[1230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442803, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:43.898129 1244 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:43.898635 1244 webserver.cc:460] Webserver started at http://127.9.127.254:43393/ using document root <none> and password file <none>
I20260811 10:06:43.898867 1244 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:43.898936 1244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:43.899103 1244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:43.900198 1244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "594f24a8386b41529f7874e48d4410a2"
format_stamp: "Formatted at 2026-08-11 10:06:43 on dist-test-slave-1x4g"
server_key: "e46c4c6b8a026a654782f9841212ed79"
server_key_iv: "4d331772febfe93d9e4dec9e6ab45c84"
server_key_version: "encryptionkey@0"
I20260811 10:06:43.900573 1244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "594f24a8386b41529f7874e48d4410a2"
format_stamp: "Formatted at 2026-08-11 10:06:43 on dist-test-slave-1x4g"
server_key: "e46c4c6b8a026a654782f9841212ed79"
server_key_iv: "4d331772febfe93d9e4dec9e6ab45c84"
server_key_version: "encryptionkey@0"
I20260811 10:06:43.901975 1244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:43.902691 1260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:43.902874 1244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:43.902977 1244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "594f24a8386b41529f7874e48d4410a2"
format_stamp: "Formatted at 2026-08-11 10:06:43 on dist-test-slave-1x4g"
server_key: "e46c4c6b8a026a654782f9841212ed79"
server_key_iv: "4d331772febfe93d9e4dec9e6ab45c84"
server_key_version: "encryptionkey@0"
I20260811 10:06:43.903061 1244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:43.920218 1244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:43.922379 1244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:43.922562 1244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:43.927065 1244 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:37973
I20260811 10:06:43.927120 1317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:37973 every 8 connection(s)
I20260811 10:06:43.927515 1244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:43.928440 1318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:43.930841 1318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2: Bootstrap starting.
I20260811 10:06:43.931491 1318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:43.931824 1318 log.cc:824] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:43.932611 1318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2: No bootstrap required, opened a new log
I20260811 10:06:43.934258 1318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594f24a8386b41529f7874e48d4410a2" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37973 } }
I20260811 10:06:43.934401 1318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:43.934424 1318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 594f24a8386b41529f7874e48d4410a2, State: Initialized, Role: FOLLOWER
I20260811 10:06:43.934612 1318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594f24a8386b41529f7874e48d4410a2" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37973 } }
I20260811 10:06:43.934677 1318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:43.934698 1318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:43.934769 1318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:43.935659 1318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594f24a8386b41529f7874e48d4410a2" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37973 } }
I20260811 10:06:43.935781 1318 leader_election.cc:302] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 594f24a8386b41529f7874e48d4410a2; no voters:
I20260811 10:06:43.935969 1318 leader_election.cc:288] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:43.936021 1322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:43.936206 1322 raft_consensus.cc:686] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [term 1 LEADER]: Becoming Leader. State: Replica: 594f24a8386b41529f7874e48d4410a2, State: Running, Role: LEADER
I20260811 10:06:43.936268 1318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:43.936282 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 1244
I20260811 10:06:43.936336 1322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594f24a8386b41529f7874e48d4410a2" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37973 } }
I20260811 10:06:43.936398 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:43.936609 9727 external_mini_cluster.cc:1428] Setting key ce466641a028404f6da8d3ae3838c753
I20260811 10:06:43.936800 1323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "594f24a8386b41529f7874e48d4410a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594f24a8386b41529f7874e48d4410a2" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37973 } } }
I20260811 10:06:43.936889 1323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:43.936769 1322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 594f24a8386b41529f7874e48d4410a2. Latest consensus state: current_term: 1 leader_uuid: "594f24a8386b41529f7874e48d4410a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "594f24a8386b41529f7874e48d4410a2" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 37973 } } }
I20260811 10:06:43.937006 1322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2 [sys.catalog]: This master's current role is: LEADER
W20260811 10:06:43.938721 1340 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:43.938830 1340 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:43.939043 1341 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:43.939250 1341 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:43.940702 1341 catalog_manager.cc:1347] Generated new cluster ID: f80a979448dc4dc2b5ababdedb9ee9a7
I20260811 10:06:43.940755 1341 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 10:06:43 dist-test-slave-1x4g krb5kdc[1230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:43.948872 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:43.937390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59021 (local address 127.9.127.254:37973)
0811 10:06:43.937588 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:43.937598 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:43.937634 (+ 36us) server_negotiation.cc:407] Connection header received
0811 10:06:43.937761 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:43.937767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:43.937812 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:43.937955 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:43.938865 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:43.940266 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:43.941384 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:43.942034 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:43.942176 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:43.945073 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:43.945077 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:43.945077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:43.945089 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:43.947089 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:43.947561 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:43.947564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:43.947564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:43.947675 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:43.947926 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:43.947927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:43.947927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:43.948213 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:43.948377 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:43.948537 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 10:06:43.948637 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":119,"threads_started":1}
I20260811 10:06:43.949940 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:43.958624 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:43.951356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54221 (local address 127.9.127.254:37973)
0811 10:06:43.951404 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:43.951406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:43.951517 (+ 111us) server_negotiation.cc:407] Connection header received
0811 10:06:43.951547 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:43.951547 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:43.951558 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:43.951627 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:43.952208 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:43.953010 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:43.953953 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:43.954296 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:43.954368 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:43.955691 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:43.955692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:43.955693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:43.955701 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:43.957392 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:43.957790 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:43.957791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:43.957791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:43.957855 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:43.958085 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:43.958086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:43.958086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:43.958220 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:43.958343 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:43.958454 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 10:06:43.958521 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:06:43.960886 1341 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:43.961349 1341 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:43.966698 1341 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 594f24a8386b41529f7874e48d4410a2: Generated new TSK 0
I20260811 10:06:43.966871 1341 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:43.972236 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 1244
W20260811 10:06:43.980679 1228 connection.cc:535] client connection to 127.9.127.254:37973 recv error: Network error: failed to read from TLS socket (remote: 127.9.127.254:37973): Connection reset by peer (error 104)
2026-08-11T10:06:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1378 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:44 dist-test-slave-1x4g krb5kdc[1354](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:44 dist-test-slave-1x4g krb5kdc[1354](info): set up 2 sockets
Aug 11 10:06:44 dist-test-slave-1x4g krb5kdc[1354](info): commencing operation
krb5kdc: starting...
W20260811 10:06:45.060982 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:45 dist-test-slave-1x4g krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:45.183540 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35155
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:44845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:35155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:45.264760 1369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:45.265002 1369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:45.265038 1369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:45.266162 1369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:45.266229 1369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:45.266253 1369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:45.266280 1369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:45.266306 1369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:45.267719 1369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:44845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:35155
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:35155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:45.267984 1369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:45.268206 1369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:45.272948 1378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:45.272926 1375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:45.272991 1369 server_base.cc:1034] running on GCE node
W20260811 10:06:45.272934 1376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:45.273450 1369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:45.273757 1369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:45.274924 1369 hybrid_clock.cc:648] HybridClock initialized: now 1786442805274912 us; error 43 us; skew 500 ppm
Aug 11 10:06:45 dist-test-slave-1x4g krb5kdc[1354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442805, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:45.277455 1369 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:45.277832 1369 webserver.cc:460] Webserver started at http://127.9.127.254:41217/ using document root <none> and password file <none>
I20260811 10:06:45.278164 1369 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:45.278213 1369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:45.278301 1369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:45.279294 1369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "5509099e54a54d71ab8a2f7859868810"
format_stamp: "Formatted at 2026-08-11 10:06:45 on dist-test-slave-1x4g"
server_key: "3144cfbbf45bf8f73aad59e5a1adfc0d"
server_key_iv: "3c7bb1f958b1e81cca47ba7277d7e5a5"
server_key_version: "encryptionkey@0"
I20260811 10:06:45.279603 1369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "5509099e54a54d71ab8a2f7859868810"
format_stamp: "Formatted at 2026-08-11 10:06:45 on dist-test-slave-1x4g"
server_key: "3144cfbbf45bf8f73aad59e5a1adfc0d"
server_key_iv: "3c7bb1f958b1e81cca47ba7277d7e5a5"
server_key_version: "encryptionkey@0"
I20260811 10:06:45.280907 1369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:06:45.281648 1386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:45.281816 1369 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:45.281906 1369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "5509099e54a54d71ab8a2f7859868810"
format_stamp: "Formatted at 2026-08-11 10:06:45 on dist-test-slave-1x4g"
server_key: "3144cfbbf45bf8f73aad59e5a1adfc0d"
server_key_iv: "3c7bb1f958b1e81cca47ba7277d7e5a5"
server_key_version: "encryptionkey@0"
I20260811 10:06:45.281998 1369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:45.296413 1369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:45.298707 1369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:45.298815 1369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:45.302662 1369 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:35155
I20260811 10:06:45.302724 1446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:35155 every 8 connection(s)
I20260811 10:06:45.303110 1369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:45.304019 1447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:45.306291 1447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810: Bootstrap starting.
I20260811 10:06:45.306870 1447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:45.307173 1447 log.cc:824] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:45.307864 1447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810: No bootstrap required, opened a new log
I20260811 10:06:45.308703 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 1369
I20260811 10:06:45.308838 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:45.309048 9727 external_mini_cluster.cc:1428] Setting key 1b6ee591de71d2dd108773cf8b87d627
I20260811 10:06:45.310022 1447 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5509099e54a54d71ab8a2f7859868810" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35155 } }
I20260811 10:06:45.310178 1447 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:45.310242 1447 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5509099e54a54d71ab8a2f7859868810, State: Initialized, Role: FOLLOWER
I20260811 10:06:45.310406 1447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5509099e54a54d71ab8a2f7859868810" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35155 } }
I20260811 10:06:45.310518 1447 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:45.310563 1447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:45.310642 1447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:45.311179 1447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5509099e54a54d71ab8a2f7859868810" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35155 } }
I20260811 10:06:45.311299 1447 leader_election.cc:302] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5509099e54a54d71ab8a2f7859868810; no voters:
I20260811 10:06:45.311511 1447 leader_election.cc:288] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:45.311549 1452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:45.311664 1452 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [term 1 LEADER]: Becoming Leader. State: Replica: 5509099e54a54d71ab8a2f7859868810, State: Running, Role: LEADER
I20260811 10:06:45.311793 1447 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:45.311805 1452 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5509099e54a54d71ab8a2f7859868810" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35155 } }
I20260811 10:06:45.312252 1452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5509099e54a54d71ab8a2f7859868810. Latest consensus state: current_term: 1 leader_uuid: "5509099e54a54d71ab8a2f7859868810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5509099e54a54d71ab8a2f7859868810" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35155 } } }
I20260811 10:06:45.312268 1453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5509099e54a54d71ab8a2f7859868810" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5509099e54a54d71ab8a2f7859868810" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 35155 } } }
I20260811 10:06:45.312392 1452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:45.312405 1453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:45.312705 1462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:45.313352 1462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:45.314999 1462 catalog_manager.cc:1347] Generated new cluster ID: 2cdff4ba6cce409f954fbd0de7e99cb4
I20260811 10:06:45.315049 1462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:45.315235 1451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:45.309599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32797 (local address 127.9.127.254:35155)
0811 10:06:45.309800 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:45.309809 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:45.309841 (+ 32us) server_negotiation.cc:407] Connection header received
0811 10:06:45.309985 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:45.309990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:45.310030 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:45.310155 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:45.310386 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:45.311880 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:45.313061 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:45.313650 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:45.313770 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:45.314524 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:45.314528 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:45.314528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:45.314743 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:45.314786 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:45.314797 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:45.314894 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:45.314983 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 10:06:45.315013 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260811 10:06:45.316160 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:45.320574 1451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:45.317686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35677 (local address 127.9.127.254:35155)
0811 10:06:45.317729 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:45.317731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:45.317868 (+ 137us) server_negotiation.cc:407] Connection header received
0811 10:06:45.317943 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:45.317944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:45.317954 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:45.318002 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:45.318119 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:45.318616 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:45.319354 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:45.319600 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:45.319676 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:45.320305 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:45.320307 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:45.320307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:45.320311 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:45.320324 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:45.320327 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:45.320375 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:45.320449 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 10:06:45.320460 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:06:45.338145 1462 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:45.338898 1462 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:45.359957 1462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5509099e54a54d71ab8a2f7859868810: Generated new TSK 0
I20260811 10:06:45.360180 1462 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:45.366374 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 1369
W20260811 10:06:45.374264 1352 connection.cc:535] client connection to 127.9.127.254:35155 recv error: Network error: failed to read from TLS socket (remote: 127.9.127.254:35155): Connection reset by peer (error 104)
2026-08-11T10:06:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1393 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:45 dist-test-slave-1x4g krb5kdc[1479](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:45 dist-test-slave-1x4g krb5kdc[1479](info): set up 2 sockets
Aug 11 10:06:45 dist-test-slave-1x4g krb5kdc[1479](info): commencing operation
krb5kdc: starting...
W20260811 10:06:46.433784 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:46 dist-test-slave-1x4g krb5kdc[1479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:46.554791 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:42973
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:40911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:42973
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:46.636538 1494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:46.636850 1494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:46.636921 1494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:46.638058 1494 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:46.638130 1494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:46.638156 1494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:46.638183 1494 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:46.638212 1494 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:46.639866 1494 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:40911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:42973
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:42973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:46.640153 1494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:46.640384 1494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:46.645215 1500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:46.645226 1503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:46.645232 1501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:46.645352 1494 server_base.cc:1034] running on GCE node
I20260811 10:06:46.645664 1494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:46.645952 1494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:46.647099 1494 hybrid_clock.cc:648] HybridClock initialized: now 1786442806647086 us; error 29 us; skew 500 ppm
Aug 11 10:06:46 dist-test-slave-1x4g krb5kdc[1479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442806, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:46.653251 1494 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:46.653676 1494 webserver.cc:460] Webserver started at http://127.9.127.254:32985/ using document root <none> and password file <none>
I20260811 10:06:46.653926 1494 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:46.653995 1494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:46.654141 1494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:46.655234 1494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "6535b481c7884185bd3db054da135538"
format_stamp: "Formatted at 2026-08-11 10:06:46 on dist-test-slave-1x4g"
server_key: "b8e9b8e9f4607f1af01b85720ba2a8d8"
server_key_iv: "927d8dd8ef1983808f824bbfab28817e"
server_key_version: "encryptionkey@0"
I20260811 10:06:46.655633 1494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "6535b481c7884185bd3db054da135538"
format_stamp: "Formatted at 2026-08-11 10:06:46 on dist-test-slave-1x4g"
server_key: "b8e9b8e9f4607f1af01b85720ba2a8d8"
server_key_iv: "927d8dd8ef1983808f824bbfab28817e"
server_key_version: "encryptionkey@0"
I20260811 10:06:46.657039 1494 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:06:46.657745 1511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:46.657970 1494 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:46.658084 1494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "6535b481c7884185bd3db054da135538"
format_stamp: "Formatted at 2026-08-11 10:06:46 on dist-test-slave-1x4g"
server_key: "b8e9b8e9f4607f1af01b85720ba2a8d8"
server_key_iv: "927d8dd8ef1983808f824bbfab28817e"
server_key_version: "encryptionkey@0"
I20260811 10:06:46.658159 1494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:46.661592 1494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:46.663940 1494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:46.664098 1494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:46.668228 1494 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:42973
I20260811 10:06:46.668280 1572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:42973 every 8 connection(s)
I20260811 10:06:46.668627 1494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:46.669312 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 1494
I20260811 10:06:46.669433 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:46.669610 9727 external_mini_cluster.cc:1428] Setting key 92c392c3de4a5530da31af58218882f2
I20260811 10:06:46.669857 1574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:46.672554 1577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:46.670369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46325 (local address 127.9.127.254:42973)
0811 10:06:46.670584 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:46.670594 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:46.670628 (+ 34us) server_negotiation.cc:407] Connection header received
0811 10:06:46.671069 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:46.671086 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:46.671120 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:46.671270 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:46.672091 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:46.672095 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:46.672095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:46.672100 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:46.672148 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:46.672163 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:46.672239 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:46.672307 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 10:06:46.672345 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":81,"threads_started":1}
I20260811 10:06:46.673323 1574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538: Bootstrap starting.
I20260811 10:06:46.673846 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:46.674054 1574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:46.674384 1574 log.cc:824] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:46.675200 1574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538: No bootstrap required, opened a new log
I20260811 10:06:46.676524 1577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:46.675528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47303 (local address 127.9.127.254:42973)
0811 10:06:46.675563 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:46.675565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:46.675704 (+ 139us) server_negotiation.cc:407] Connection header received
0811 10:06:46.675772 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:46.675772 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:46.675776 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:46.675820 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:46.676347 (+ 527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:46.676348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:46.676348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:46.676351 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:46.676363 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:46.676366 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:46.676406 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:46.676469 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 10:06:46.676484 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:06:46.677763 1574 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6535b481c7884185bd3db054da135538" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42973 } }
I20260811 10:06:46.677896 1574 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:46.677919 1574 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6535b481c7884185bd3db054da135538, State: Initialized, Role: FOLLOWER
I20260811 10:06:46.678056 1574 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6535b481c7884185bd3db054da135538" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42973 } }
I20260811 10:06:46.678143 1574 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:46.678186 1574 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:46.678237 1574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:46.678766 1574 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6535b481c7884185bd3db054da135538" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42973 } }
I20260811 10:06:46.678855 1574 leader_election.cc:302] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6535b481c7884185bd3db054da135538; no voters:
I20260811 10:06:46.679032 1574 leader_election.cc:288] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:46.679111 1584 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:46.679273 1584 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [term 1 LEADER]: Becoming Leader. State: Replica: 6535b481c7884185bd3db054da135538, State: Running, Role: LEADER
I20260811 10:06:46.679286 1574 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:46.679425 1584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6535b481c7884185bd3db054da135538" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42973 } }
I20260811 10:06:46.679776 1585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6535b481c7884185bd3db054da135538" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6535b481c7884185bd3db054da135538" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42973 } } }
I20260811 10:06:46.679793 1586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6535b481c7884185bd3db054da135538. Latest consensus state: current_term: 1 leader_uuid: "6535b481c7884185bd3db054da135538" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6535b481c7884185bd3db054da135538" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42973 } } }
I20260811 10:06:46.679889 1585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:46.679989 1586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:46.680214 1593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:46.680758 1593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:46.682423 1593 catalog_manager.cc:1347] Generated new cluster ID: efe503148cf54d47ae218cc717b1bf21
I20260811 10:06:46.682492 1593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:46.688513 1593 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:46.688688 1593 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:46.690909 1593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6535b481c7884185bd3db054da135538: Generated new TSK 0
I20260811 10:06:46.691099 1593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:46.695717 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 1494
2026-08-11T10:06:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1330 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:46 dist-test-slave-1x4g krb5kdc[1606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:46 dist-test-slave-1x4g krb5kdc[1606](info): set up 2 sockets
Aug 11 10:06:46 dist-test-slave-1x4g krb5kdc[1606](info): commencing operation
krb5kdc: starting...
W20260811 10:06:47.763041 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:47 dist-test-slave-1x4g krb5kdc[1606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:47.880975 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:34491
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:41569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:34491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:47.961472 1619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:47.961670 1619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:47.961694 1619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:47.962765 1619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:47.962798 1619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:47.962812 1619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:47.962826 1619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:47.962837 1619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:47.964185 1619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:41569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:34491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:34491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:47.964365 1619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:47.964517 1619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:47.969270 1624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:47.969250 1625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:47.969260 1627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:47.969592 1619 server_base.cc:1034] running on GCE node
I20260811 10:06:47.969928 1619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:47.970211 1619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:47.971385 1619 hybrid_clock.cc:648] HybridClock initialized: now 1786442807971369 us; error 45 us; skew 500 ppm
Aug 11 10:06:47 dist-test-slave-1x4g krb5kdc[1606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442807, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:47.973950 1619 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:47.974418 1619 webserver.cc:460] Webserver started at http://127.9.127.254:39679/ using document root <none> and password file <none>
I20260811 10:06:47.974601 1619 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:47.974643 1619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:47.974728 1619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:47.975709 1619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "fadaebafeeb94c45889d2d98a2c28b3b"
format_stamp: "Formatted at 2026-08-11 10:06:47 on dist-test-slave-1x4g"
server_key: "11e67ea6874ec1af5e8ab1dd7d0c2a45"
server_key_iv: "81dbf738af308eadf3897d41837feb3d"
server_key_version: "encryptionkey@0"
I20260811 10:06:47.976002 1619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "fadaebafeeb94c45889d2d98a2c28b3b"
format_stamp: "Formatted at 2026-08-11 10:06:47 on dist-test-slave-1x4g"
server_key: "11e67ea6874ec1af5e8ab1dd7d0c2a45"
server_key_iv: "81dbf738af308eadf3897d41837feb3d"
server_key_version: "encryptionkey@0"
I20260811 10:06:47.977356 1619 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:06:47.978039 1634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:47.978225 1619 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:47.978305 1619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "fadaebafeeb94c45889d2d98a2c28b3b"
format_stamp: "Formatted at 2026-08-11 10:06:47 on dist-test-slave-1x4g"
server_key: "11e67ea6874ec1af5e8ab1dd7d0c2a45"
server_key_iv: "81dbf738af308eadf3897d41837feb3d"
server_key_version: "encryptionkey@0"
I20260811 10:06:47.978358 1619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:47.988544 1619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:47.990228 1619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:47.990327 1619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:47.994004 1619 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:34491
I20260811 10:06:47.994077 1694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:34491 every 8 connection(s)
I20260811 10:06:47.994383 1619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:47.995235 1695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:47.995776 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 1619
I20260811 10:06:47.995886 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:47.996066 9727 external_mini_cluster.cc:1428] Setting key 3bcc548cad64eb8574a09bf75726006f
I20260811 10:06:47.998296 1695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b: Bootstrap starting.
I20260811 10:06:47.998991 1695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:47.999303 1695 log.cc:824] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:48.000011 1695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b: No bootstrap required, opened a new log
I20260811 10:06:48.002156 1695 raft_consensus.cc:348] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fadaebafeeb94c45889d2d98a2c28b3b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34491 } }
I20260811 10:06:48.002283 1695 raft_consensus.cc:374] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:48.002305 1695 raft_consensus.cc:729] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fadaebafeeb94c45889d2d98a2c28b3b, State: Initialized, Role: FOLLOWER
I20260811 10:06:48.002444 1695 consensus_queue.cc:260] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fadaebafeeb94c45889d2d98a2c28b3b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34491 } }
I20260811 10:06:48.002542 1695 raft_consensus.cc:388] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:48.002583 1695 raft_consensus.cc:482] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:48.002642 1695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 0 FOLLOWER]: Advancing to term 1
Aug 11 10:06:48 dist-test-slave-1x4g krb5kdc[1606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:48.003311 1695 raft_consensus.cc:504] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fadaebafeeb94c45889d2d98a2c28b3b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34491 } }
I20260811 10:06:48.003423 1695 leader_election.cc:302] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fadaebafeeb94c45889d2d98a2c28b3b; no voters:
I20260811 10:06:48.003619 1695 leader_election.cc:288] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:48.003654 1700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:48.003837 1700 raft_consensus.cc:686] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [term 1 LEADER]: Becoming Leader. State: Replica: fadaebafeeb94c45889d2d98a2c28b3b, State: Running, Role: LEADER
I20260811 10:06:48.003926 1695 sys_catalog.cc:564] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:48.004004 1700 consensus_queue.cc:237] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fadaebafeeb94c45889d2d98a2c28b3b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34491 } }
I20260811 10:06:48.004428 1703 sys_catalog.cc:455] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fadaebafeeb94c45889d2d98a2c28b3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fadaebafeeb94c45889d2d98a2c28b3b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34491 } } }
I20260811 10:06:48.004508 1703 sys_catalog.cc:458] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:48.004835 1702 sys_catalog.cc:455] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fadaebafeeb94c45889d2d98a2c28b3b. Latest consensus state: current_term: 1 leader_uuid: "fadaebafeeb94c45889d2d98a2c28b3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fadaebafeeb94c45889d2d98a2c28b3b" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 34491 } } }
I20260811 10:06:48.004959 1702 sys_catalog.cc:458] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:48.005566 1708 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:48.006120 1708 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:48.008015 1698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:47.996603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49129 (local address 127.9.127.254:34491)
0811 10:06:47.996852 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:47.996862 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:47.996898 (+ 36us) server_negotiation.cc:407] Connection header received
0811 10:06:47.997436 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:47.997445 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:47.997506 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:47.997654 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:47.998254 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:47.999610 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:48.000404 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:48.001029 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:48.001161 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:48.003756 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:48.003760 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:48.003761 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:48.003774 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:48.006243 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:48.006662 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:48.006666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:48.006666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:48.006774 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:48.007009 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:48.007010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:48.007010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:48.007332 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:48.007478 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:48.007576 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 10:06:48.007826 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260811 10:06:48.009083 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:48.013363 1708 catalog_manager.cc:1347] Generated new cluster ID: 9da1d8f85bd9499db077c10f1cca0aed
I20260811 10:06:48.013427 1708 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:48.017400 1698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:48.010355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58195 (local address 127.9.127.254:34491)
0811 10:06:48.010410 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:48.010411 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:48.010502 (+ 91us) server_negotiation.cc:407] Connection header received
0811 10:06:48.010553 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:48.010554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:48.010562 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:48.010607 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:48.011230 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:48.011757 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:48.012845 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:48.013172 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:48.013240 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:48.014581 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:48.014583 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:48.014583 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:48.014590 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:48.016031 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:48.016439 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:48.016440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:48.016441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:48.016493 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:48.016733 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:48.016734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:48.016734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:48.016888 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:48.016958 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:48.017228 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 10:06:48.017308 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 10:06:48.028939 1708 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:48.029467 1708 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:48.032387 1708 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fadaebafeeb94c45889d2d98a2c28b3b: Generated new TSK 0
I20260811 10:06:48.032624 1708 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:48.038075 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 1619
2026-08-11T10:06:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1341 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:48 dist-test-slave-1x4g krb5kdc[1731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:48 dist-test-slave-1x4g krb5kdc[1731](info): set up 2 sockets
Aug 11 10:06:48 dist-test-slave-1x4g krb5kdc[1731](info): commencing operation
krb5kdc: starting...
W20260811 10:06:49.119155 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:49 dist-test-slave-1x4g krb5kdc[1731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:49.240283 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:38007
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:36735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:38007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:49.322175 1744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:49.322423 1744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:49.322470 1744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:49.323652 1744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:49.323720 1744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:49.323745 1744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:49.323765 1744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:49.323794 1744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:49.325390 1744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:36735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:38007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:38007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:49.325655 1744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:49.325882 1744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 10:06:49.330879 1744 server_base.cc:1034] running on GCE node
W20260811 10:06:49.331002 1750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:49.330960 1749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:49.331225 1752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:49.331512 1744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:49.331800 1744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:49.332957 1744 hybrid_clock.cc:648] HybridClock initialized: now 1786442809332952 us; error 35 us; skew 500 ppm
Aug 11 10:06:49 dist-test-slave-1x4g krb5kdc[1731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442809, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:49.335376 1744 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:49.335757 1744 webserver.cc:460] Webserver started at http://127.9.127.254:45513/ using document root <none> and password file <none>
I20260811 10:06:49.335929 1744 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:49.335968 1744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:49.336051 1744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:49.337167 1744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "24262f332aab42a5b89dd86eac7b26ac"
format_stamp: "Formatted at 2026-08-11 10:06:49 on dist-test-slave-1x4g"
server_key: "f0be4751eed6d1bb884fda6a7e5ee3eb"
server_key_iv: "3699489a4b6febfa2ee015d8ac7df377"
server_key_version: "encryptionkey@0"
I20260811 10:06:49.337479 1744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "24262f332aab42a5b89dd86eac7b26ac"
format_stamp: "Formatted at 2026-08-11 10:06:49 on dist-test-slave-1x4g"
server_key: "f0be4751eed6d1bb884fda6a7e5ee3eb"
server_key_iv: "3699489a4b6febfa2ee015d8ac7df377"
server_key_version: "encryptionkey@0"
I20260811 10:06:49.338794 1744 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:49.339483 1760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:49.339663 1744 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:49.339736 1744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "24262f332aab42a5b89dd86eac7b26ac"
format_stamp: "Formatted at 2026-08-11 10:06:49 on dist-test-slave-1x4g"
server_key: "f0be4751eed6d1bb884fda6a7e5ee3eb"
server_key_iv: "3699489a4b6febfa2ee015d8ac7df377"
server_key_version: "encryptionkey@0"
I20260811 10:06:49.339787 1744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:49.361289 1744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:49.363145 1744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:49.363265 1744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:49.367324 1744 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:38007
I20260811 10:06:49.367396 1821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:38007 every 8 connection(s)
I20260811 10:06:49.367676 1744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:49.368505 1822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:49.370870 1822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac: Bootstrap starting.
I20260811 10:06:49.371485 1822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:49.371775 1822 log.cc:824] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:49.372555 1822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac: No bootstrap required, opened a new log
I20260811 10:06:49.374094 1822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24262f332aab42a5b89dd86eac7b26ac" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38007 } }
I20260811 10:06:49.374229 1822 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:49.374251 1822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24262f332aab42a5b89dd86eac7b26ac, State: Initialized, Role: FOLLOWER
I20260811 10:06:49.374388 1822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24262f332aab42a5b89dd86eac7b26ac" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38007 } }
I20260811 10:06:49.374475 1822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:49.374496 1822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:49.374523 1822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:49.375289 1822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24262f332aab42a5b89dd86eac7b26ac" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38007 } }
I20260811 10:06:49.375375 1822 leader_election.cc:302] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24262f332aab42a5b89dd86eac7b26ac; no voters:
I20260811 10:06:49.375504 1822 leader_election.cc:288] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:49.375569 1825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:49.375738 1825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [term 1 LEADER]: Becoming Leader. State: Replica: 24262f332aab42a5b89dd86eac7b26ac, State: Running, Role: LEADER
I20260811 10:06:49.375771 1822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:49.375828 1825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24262f332aab42a5b89dd86eac7b26ac" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38007 } }
I20260811 10:06:49.376081 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 1744
I20260811 10:06:49.376207 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:49.376422 9727 external_mini_cluster.cc:1428] Setting key da946d7bc4fcfb91a265f0405474c9c1
I20260811 10:06:49.376435 1827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24262f332aab42a5b89dd86eac7b26ac. Latest consensus state: current_term: 1 leader_uuid: "24262f332aab42a5b89dd86eac7b26ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24262f332aab42a5b89dd86eac7b26ac" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38007 } } }
I20260811 10:06:49.376447 1826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24262f332aab42a5b89dd86eac7b26ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24262f332aab42a5b89dd86eac7b26ac" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 38007 } } }
I20260811 10:06:49.376534 1827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:49.376538 1826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:49.376822 1834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:49.377408 1834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:49.379073 1834 catalog_manager.cc:1347] Generated new cluster ID: 3d307b651fe545b3a3d95a74d182d7d2
I20260811 10:06:49.379125 1834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:49.382900 1841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:49.377064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33173 (local address 127.9.127.254:38007)
0811 10:06:49.377619 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:49.377628 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:49.377662 (+ 34us) server_negotiation.cc:407] Connection header received
0811 10:06:49.377788 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:49.377796 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:49.377849 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:49.377993 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:49.378228 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:49.379565 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:49.380678 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:49.381381 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:49.381502 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:49.382217 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:49.382221 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:49.382221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:49.382428 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:49.382467 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:49.382481 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:49.382551 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:49.382622 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 10:06:49.382693 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":62,"threads_started":1}
I20260811 10:06:49.383939 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:49.387990 1834 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:49.388463 1834 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:49.388899 1841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:49.385371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59729 (local address 127.9.127.254:38007)
0811 10:06:49.385401 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:49.385402 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:49.385526 (+ 124us) server_negotiation.cc:407] Connection header received
0811 10:06:49.385567 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:49.385568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:49.385579 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:49.385640 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:49.385748 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:49.386454 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:49.387404 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:49.387678 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:49.387745 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:49.388569 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:49.388570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:49.388571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:49.388575 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:49.388589 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:49.388593 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:49.388620 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:49.388723 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 10:06:49.388786 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 10:06:49.393776 1834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24262f332aab42a5b89dd86eac7b26ac: Generated new TSK 0
I20260811 10:06:49.393944 1834 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:49.399115 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 1744
2026-08-11T10:06:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1359 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:49 dist-test-slave-1x4g krb5kdc[1854](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:49 dist-test-slave-1x4g krb5kdc[1854](info): set up 2 sockets
Aug 11 10:06:49 dist-test-slave-1x4g krb5kdc[1854](info): commencing operation
krb5kdc: starting...
W20260811 10:06:50.484048 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:50 dist-test-slave-1x4g krb5kdc[1854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:50.611524 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:36435
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:38611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:36435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:50.694734 1870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:50.694955 1870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:50.694979 1870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:50.696066 1870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:50.696110 1870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:50.696125 1870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:50.696136 1870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:50.696148 1870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:50.697695 1870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:38611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:36435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:36435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:50.697957 1870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:50.698194 1870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:50.703042 1875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:50.703095 1870 server_base.cc:1034] running on GCE node
W20260811 10:06:50.703011 1879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:50.703014 1876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:50.703475 1870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:50.703775 1870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:50.704936 1870 hybrid_clock.cc:648] HybridClock initialized: now 1786442810704931 us; error 37 us; skew 500 ppm
Aug 11 10:06:50 dist-test-slave-1x4g krb5kdc[1854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442810, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:50.707499 1870 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:50.708056 1870 webserver.cc:460] Webserver started at http://127.9.127.254:45803/ using document root <none> and password file <none>
I20260811 10:06:50.708310 1870 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:50.708381 1870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:50.708535 1870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:50.709657 1870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "fb40601c5a494f77ab700e9e4cc7a1fe"
format_stamp: "Formatted at 2026-08-11 10:06:50 on dist-test-slave-1x4g"
server_key: "d6dd289f54d767ccc81ade243ad60ea1"
server_key_iv: "cc657469c1e44dc99bb2fd38d8bac0d2"
server_key_version: "encryptionkey@0"
I20260811 10:06:50.710021 1870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "fb40601c5a494f77ab700e9e4cc7a1fe"
format_stamp: "Formatted at 2026-08-11 10:06:50 on dist-test-slave-1x4g"
server_key: "d6dd289f54d767ccc81ade243ad60ea1"
server_key_iv: "cc657469c1e44dc99bb2fd38d8bac0d2"
server_key_version: "encryptionkey@0"
I20260811 10:06:50.711380 1870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:50.712061 1886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:50.712234 1870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:50.712334 1870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "fb40601c5a494f77ab700e9e4cc7a1fe"
format_stamp: "Formatted at 2026-08-11 10:06:50 on dist-test-slave-1x4g"
server_key: "d6dd289f54d767ccc81ade243ad60ea1"
server_key_iv: "cc657469c1e44dc99bb2fd38d8bac0d2"
server_key_version: "encryptionkey@0"
I20260811 10:06:50.712415 1870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:50.715828 1870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:50.718195 1870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:50.718360 1870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:50.722640 1870 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:36435
I20260811 10:06:50.722683 1941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:36435 every 8 connection(s)
I20260811 10:06:50.723001 1870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:50.723940 1942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:50.726321 1942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe: Bootstrap starting.
I20260811 10:06:50.726701 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 1870
I20260811 10:06:50.726853 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:50.727093 9727 external_mini_cluster.cc:1428] Setting key fcf702b57efd4de6e230f40e10fc248b
I20260811 10:06:50.727113 1942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:50.727439 1942 log.cc:824] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:50.728206 1942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe: No bootstrap required, opened a new log
I20260811 10:06:50.729696 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:50.727630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48343 (local address 127.9.127.254:36435)
0811 10:06:50.727852 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:50.727862 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:50.727893 (+ 31us) server_negotiation.cc:407] Connection header received
0811 10:06:50.728406 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:50.728412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:50.728440 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:50.728594 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:50.729277 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:50.729280 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:50.729280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:50.729285 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:50.729333 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:50.729343 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:50.729454 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:50.729500 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 10:06:50.729541 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260811 10:06:50.730798 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:50.730732 1942 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb40601c5a494f77ab700e9e4cc7a1fe" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36435 } }
I20260811 10:06:50.730921 1942 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 10:06:50.730965 1942 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb40601c5a494f77ab700e9e4cc7a1fe, State: Initialized, Role: FOLLOWER
I20260811 10:06:50.731087 1942 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb40601c5a494f77ab700e9e4cc7a1fe" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36435 } }
I20260811 10:06:50.731176 1942 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 10:06:50.731221 1942 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 10:06:50.731271 1942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:50.731880 1942 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb40601c5a494f77ab700e9e4cc7a1fe" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36435 } }
I20260811 10:06:50.732012 1942 leader_election.cc:302] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb40601c5a494f77ab700e9e4cc7a1fe; no voters:
I20260811 10:06:50.732204 1942 leader_election.cc:288] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 10:06:50.732443 1954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:50.732484 1942 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:50.732731 1954 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [term 1 LEADER]: Becoming Leader. State: Replica: fb40601c5a494f77ab700e9e4cc7a1fe, State: Running, Role: LEADER
I20260811 10:06:50.732887 1954 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb40601c5a494f77ab700e9e4cc7a1fe" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36435 } }
I20260811 10:06:50.733461 1953 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb40601c5a494f77ab700e9e4cc7a1fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb40601c5a494f77ab700e9e4cc7a1fe" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36435 } } }
I20260811 10:06:50.733682 1953 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:50.733789 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:50.732421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56687 (local address 127.9.127.254:36435)
0811 10:06:50.732521 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:50.732523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:50.732615 (+ 92us) server_negotiation.cc:407] Connection header received
0811 10:06:50.732714 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:50.732715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:50.732721 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:50.732752 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:50.733494 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:50.733495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:50.733495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 10:06:50.733500 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:50.733514 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 10:06:50.733518 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:50.733562 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:50.733714 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 10:06:50.733728 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 10:06:50.733817 1956 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb40601c5a494f77ab700e9e4cc7a1fe. Latest consensus state: current_term: 1 leader_uuid: "fb40601c5a494f77ab700e9e4cc7a1fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb40601c5a494f77ab700e9e4cc7a1fe" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36435 } } }
I20260811 10:06:50.733879 1956 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:50.734704 1963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:50.735242 1963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:50.736682 1963 catalog_manager.cc:1347] Generated new cluster ID: 2b852fb339ec4c3aac6a0cb8cc81fd11
I20260811 10:06:50.736734 1963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:50.756145 1963 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:50.756387 1963 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:50.762418 1963 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb40601c5a494f77ab700e9e4cc7a1fe: Generated new TSK 0
I20260811 10:06:50.762621 1963 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 10:06:50.768396 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 1870
2026-08-11T10:06:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1370 ms)
[----------] 18 tests from AuthTokenIssuingTest (24487 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:50 dist-test-slave-1x4g krb5kdc[1975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:50 dist-test-slave-1x4g krb5kdc[1975](info): set up 2 sockets
Aug 11 10:06:50 dist-test-slave-1x4g krb5kdc[1975](info): commencing operation
krb5kdc: starting...
W20260811 10:06:51.855707 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:51 dist-test-slave-1x4g krb5kdc[1975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:51.975844 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:36091
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:36091,127.9.127.253:38137,127.9.127.252:41337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:52.057663 1988 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 10:06:52.057888 1988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:52.057905 1988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:52.057924 1988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:52.058977 1988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:52.059015 1988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:52.059028 1988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:52.059041 1988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:52.059053 1988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:52.060443 1988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:36091,127.9.127.253:38137,127.9.127.252:41337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:36091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:52.060626 1988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:52.060801 1988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:52.065572 1995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:52.065605 1996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:52.065605 1998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:52.065905 1988 server_base.cc:1034] running on GCE node
I20260811 10:06:52.066125 1988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:52.066403 1988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:52.067556 1988 hybrid_clock.cc:648] HybridClock initialized: now 1786442812067544 us; error 32 us; skew 500 ppm
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:52.075879 1988 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:52.076344 1988 webserver.cc:460] Webserver started at http://127.9.127.254:34923/ using document root <none> and password file <none>
I20260811 10:06:52.076568 1988 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:52.076646 1988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:52.076869 1988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:52.077967 1988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "3be4f3ac1a354c189d776525213f28e9"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "44924ab3ef7881402f670ba64d48ea46"
server_key_iv: "baa5de4a629c16bb15d1cdafe1c1e886"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.078365 1988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "3be4f3ac1a354c189d776525213f28e9"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "44924ab3ef7881402f670ba64d48ea46"
server_key_iv: "baa5de4a629c16bb15d1cdafe1c1e886"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.079896 1988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 10:06:52.080890 2006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:52.081100 1988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:52.081234 1988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "3be4f3ac1a354c189d776525213f28e9"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "44924ab3ef7881402f670ba64d48ea46"
server_key_iv: "baa5de4a629c16bb15d1cdafe1c1e886"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.081338 1988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:52.100433 1988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:52.102905 1988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:52.103112 1988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:52.107431 1988 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:36091
I20260811 10:06:52.107483 2062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:36091 every 8 connection(s)
I20260811 10:06:52.107882 1988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:52.108907 2063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:52.110520 2063 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:52.111151 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 1988
I20260811 10:06:52.111285 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:52.111513 9727 external_mini_cluster.cc:1428] Setting key 6eb86099c552ab6a054d218c6762c06c
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.127.253@KRBTEST.COM; defaulting to no policy
I20260811 10:06:52.121662 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.111254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:36091 (local address 127.0.0.1:37224)
0811 10:06:52.111465 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.111514 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.112275 (+ 761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.112577 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.112581 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.112996 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.113246 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.113252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.114302 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.114304 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.115219 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.115222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.115931 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.115932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.115987 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.116580 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.116589 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.118034 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.120123 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.120130 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.120132 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.120321 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.120603 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.120604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.120604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.120684 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.121191 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.121197 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.121258 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.121335 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.121464 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":89,"threads_started":1}
I20260811 10:06:52.121666 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.111278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37224 (local address 127.9.127.254:36091)
0811 10:06:52.111443 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.111453 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.111629 (+ 176us) server_negotiation.cc:407] Connection header received
0811 10:06:52.112427 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.112429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.112446 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.112534 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.113349 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.114199 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.115313 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.115820 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.115942 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.118125 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.118139 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.118139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.118148 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.120033 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.120413 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.120416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.120417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.120522 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.120751 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.120759 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.120760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.121112 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.121207 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.121387 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.121525 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":130,"thread_start_us":75,"threads_started":1}
I20260811 10:06:52.122460 2063 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:52.122792 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.122689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38848)
0811 10:06:52.122732 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.122774 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 10:06:52.122931 2008 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
I20260811 10:06:52.123497 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.123397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38860)
0811 10:06:52.123448 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.123480 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 10:06:52.123618 2063 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:38137: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab.
Entry for principal kudu/127.9.127.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab.
I20260811 10:06:52.139008 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.253:38137
--webserver_interface=127.9.127.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab
--principal=kudu/127.9.127.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:36091,127.9.127.253:38137,127.9.127.252:41337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:06:52.172865 2063 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } attempt: 1
I20260811 10:06:52.173444 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.173303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38866)
0811 10:06:52.173377 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.173412 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 10:06:52.173818 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.173719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38878)
0811 10:06:52.173766 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.173798 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 10:06:52.173914 2063 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:38137: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
W20260811 10:06:52.222350 2070 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 10:06:52.222630 2070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:52.222661 2070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:52.222703 2070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:52.223901 2070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:52.223958 2070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:52.223977 2070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:52.223994 2070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:52.224015 2070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:52.225498 2070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:36091,127.9.127.253:38137,127.9.127.252:41337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab
--principal=kudu/127.9.127.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.253:38137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.127.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:52.225765 2070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:52.225996 2070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:52.230762 2075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:52.230751 2078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:52.230827 2076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:52.231078 2070 server_base.cc:1034] running on GCE node
I20260811 10:06:52.231310 2070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:52.231542 2070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:52.232698 2070 hybrid_clock.cc:648] HybridClock initialized: now 1786442812232677 us; error 28 us; skew 500 ppm
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:52.235284 2070 init.cc:377] Logged in from keytab as kudu/127.9.127.253@KRBTEST.COM (short username kudu)
I20260811 10:06:52.235716 2070 webserver.cc:460] Webserver started at http://127.9.127.253:44907/ using document root <none> and password file <none>
I20260811 10:06:52.235961 2070 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:52.236047 2070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:52.236203 2070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:52.237329 2070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/data/instance:
uuid: "6e6506ed034b404c917cef3aa5930e23"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "edd47c06b6bbe24a71046c7e8ae168f7"
server_key_iv: "019d2f80dcf6e9a456998d127e932b9a"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.237696 2070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/wal/instance:
uuid: "6e6506ed034b404c917cef3aa5930e23"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "edd47c06b6bbe24a71046c7e8ae168f7"
server_key_iv: "019d2f80dcf6e9a456998d127e932b9a"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.239022 2070 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:52.239739 2085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:52.239907 2070 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:52.240017 2070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/wal
uuid: "6e6506ed034b404c917cef3aa5930e23"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "edd47c06b6bbe24a71046c7e8ae168f7"
server_key_iv: "019d2f80dcf6e9a456998d127e932b9a"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.240110 2070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:52.242049 2063 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } attempt: 2
I20260811 10:06:52.242429 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.242287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38892)
0811 10:06:52.242350 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.242391 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 10:06:52.242828 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.242731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38902)
0811 10:06:52.242779 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.242805 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 10:06:52.242946 2063 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:38137: Network error: Client connection negotiation failed: client connection to 127.9.127.253:38137: connect: Connection refused (error 111)
I20260811 10:06:52.270534 2070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:52.272392 2070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:52.272553 2070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:52.276551 2070 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.253:38137
I20260811 10:06:52.276623 2143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.253:38137 every 8 connection(s)
I20260811 10:06:52.277025 2070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
I20260811 10:06:52.278059 2144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:52.279685 2144 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:52.284494 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 2070
I20260811 10:06:52.284726 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-1/wal/instance
I20260811 10:06:52.285005 9727 external_mini_cluster.cc:1428] Setting key c7fe562c9c91c8605b2e4654a0cb42dd
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:52.289037 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.280373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37232 (local address 127.9.127.254:36091)
0811 10:06:52.280446 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.280463 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.280652 (+ 189us) server_negotiation.cc:407] Connection header received
0811 10:06:52.281169 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.281170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.281185 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.281241 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.281839 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.282337 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.283372 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.283613 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.283690 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.285876 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.285877 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.285877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.285886 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.287591 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.288004 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.288006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.288006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.288070 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.288358 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.288359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.288359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.288463 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.288515 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.288866 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.288942 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 10:06:52.289335 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.280336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:36091 (local address 127.0.0.1:37232)
0811 10:06:52.280533 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.280566 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.281064 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.281310 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.281314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.281549 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.281743 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.281746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.282448 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.282449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.283278 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.283280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.283743 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.283744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.283860 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.284295 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.284303 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.285780 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.287682 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.287689 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.287691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.287910 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.288145 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.288146 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.288146 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.288292 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.288527 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.288534 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.288709 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.288850 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.289061 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
I20260811 10:06:52.290026 2144 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.9.127.252@KRBTEST.COM; defaulting to no policy
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.252@KRBTEST.COM" created.
I20260811 10:06:52.297816 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.290321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38904)
0811 10:06:52.290584 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.290595 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.290648 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.290781 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.290782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.290956 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.291020 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.291022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.291881 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.291882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.292704 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.292707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.293210 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.293212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.293293 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.293645 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.293650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.294934 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.296706 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.296707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.296707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.296945 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.297172 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.297173 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.297173 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.297232 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.297501 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.297502 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.297541 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.297606 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.297703 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235}
I20260811 10:06:52.297909 2149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.290396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38904 (local address 127.9.127.253:38137)
0811 10:06:52.290566 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.290570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.290641 (+ 71us) server_negotiation.cc:407] Connection header received
0811 10:06:52.290706 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.290708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.290718 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.290777 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.291114 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.291795 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.292820 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.293130 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.293186 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.295051 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.295075 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.295076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.295083 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.296603 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.297042 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.297045 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.297045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.297104 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.297282 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.297283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.297283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.297427 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.297520 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.297633 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.297774 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":146,"thread_start_us":120,"threads_started":1}
I20260811 10:06:52.298446 2144 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:52.298818 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.298678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60476)
0811 10:06:52.298729 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.298786 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 10:06:52.298954 2090 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
I20260811 10:06:52.299465 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.299349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60478)
0811 10:06:52.299402 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.299436 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 10:06:52.299583 2144 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41337: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab.
Entry for principal kudu/127.9.127.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab.
I20260811 10:06:52.311681 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.252:41337
--webserver_interface=127.9.127.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab
--principal=kudu/127.9.127.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:42129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:36091,127.9.127.253:38137,127.9.127.252:41337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:06:52.334139 2063 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } attempt: 3
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
I20260811 10:06:52.341637 2149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.334658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38916 (local address 127.9.127.253:38137)
0811 10:06:52.334728 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.334730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.334742 (+ 12us) server_negotiation.cc:407] Connection header received
0811 10:06:52.334779 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.334780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.334791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.334855 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.335214 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.335716 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.336508 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.336749 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.336893 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.338931 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.338932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.338933 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.338940 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.340456 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.340884 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.340885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.340886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.340942 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.341167 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.341167 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.341168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.341295 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.341346 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.341507 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.341572 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 10:06:52.341684 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.334550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38916)
0811 10:06:52.334620 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.334630 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.334693 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.334864 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.334865 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.335043 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.335125 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.335127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.335830 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.335832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.336380 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.336382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.336893 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.336895 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.336988 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.337481 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.337486 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.338823 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.340550 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.340551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.340552 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.340817 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.341030 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.341030 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.341031 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.341103 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.341358 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.341359 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.341411 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.341482 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.341592 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 10:06:52.342139 2063 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:52.342490 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.342381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60488)
0811 10:06:52.342432 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.342467 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 10:06:52.342914 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.342787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60496)
0811 10:06:52.342857 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.342888 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 10:06:52.343057 2063 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41337: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
I20260811 10:06:52.348843 2144 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } attempt: 1
I20260811 10:06:52.349210 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.349097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60512)
0811 10:06:52.349151 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.349179 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 10:06:52.349503 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.349414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60520)
0811 10:06:52.349459 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.349483 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 10:06:52.349597 2144 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41337: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
I20260811 10:06:52.374241 2063 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } attempt: 1
I20260811 10:06:52.374702 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.374577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60532)
0811 10:06:52.374636 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.374672 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 10:06:52.375106 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.375021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60536)
0811 10:06:52.375063 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.375089 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 10:06:52.375217 2063 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41337: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
W20260811 10:06:52.397838 2152 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 10:06:52.398106 2152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:52.398137 2152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:52.398180 2152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:52.399307 2152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:52.399374 2152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:52.399398 2152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:52.399421 2152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:52.399449 2152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:52.400962 2152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:42129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:36091,127.9.127.253:38137,127.9.127.252:41337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab
--principal=kudu/127.9.127.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.252:41337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.127.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:52.401268 2152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:52.401508 2152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:52.406311 2160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:52.406308 2157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:52.406304 2158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:52.406713 2152 server_base.cc:1034] running on GCE node
I20260811 10:06:52.407015 2152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:52.407327 2152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:52.408474 2152 hybrid_clock.cc:648] HybridClock initialized: now 1786442812408446 us; error 50 us; skew 500 ppm
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:52.411137 2152 init.cc:377] Logged in from keytab as kudu/127.9.127.252@KRBTEST.COM (short username kudu)
I20260811 10:06:52.411636 2152 webserver.cc:460] Webserver started at http://127.9.127.252:37925/ using document root <none> and password file <none>
I20260811 10:06:52.411867 2152 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:52.411926 2152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:52.412074 2152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:52.413241 2152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/data/instance:
uuid: "3c5621db1aa448a7bce995ccc4af6576"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "ae68ae8d2466c958559e3ac735ea62ee"
server_key_iv: "bd140c78a740e5295ac49144e6960b7b"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.413621 2152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/wal/instance:
uuid: "3c5621db1aa448a7bce995ccc4af6576"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "ae68ae8d2466c958559e3ac735ea62ee"
server_key_iv: "bd140c78a740e5295ac49144e6960b7b"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.414943 2152 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:52.415709 2167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:52.415925 2152 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 10:06:52.416018 2152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/wal
uuid: "3c5621db1aa448a7bce995ccc4af6576"
format_stamp: "Formatted at 2026-08-11 10:06:52 on dist-test-slave-1x4g"
server_key: "ae68ae8d2466c958559e3ac735ea62ee"
server_key_iv: "bd140c78a740e5295ac49144e6960b7b"
server_key_version: "encryptionkey@0"
I20260811 10:06:52.416092 2152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:52.417755 2144 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } attempt: 2
I20260811 10:06:52.418181 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.418059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60544)
0811 10:06:52.418116 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.418152 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 10:06:52.418627 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.418497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60546)
0811 10:06:52.418575 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.418605 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 10:06:52.418761 2144 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41337: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41337: connect: Connection refused (error 111)
I20260811 10:06:52.427266 2152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:52.429315 2152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:52.429468 2152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:52.433740 2152 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.252:41337
I20260811 10:06:52.433789 2226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.252:41337 every 8 connection(s)
I20260811 10:06:52.434186 2152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
I20260811 10:06:52.435207 2227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:52.436554 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 2152
I20260811 10:06:52.436662 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786442543469380-9727-0/minicluster-data/master-2/wal/instance
I20260811 10:06:52.436916 9727 external_mini_cluster.cc:1428] Setting key 844284a70e4ce3727fb410ed1fc048c4
I20260811 10:06:52.437086 2227 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:06:52.446655 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.437981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.9.127.254:36091)
0811 10:06:52.438032 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.438034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.438190 (+ 156us) server_negotiation.cc:407] Connection header received
0811 10:06:52.438488 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.438490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.438503 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.438570 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.439125 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.439621 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.440686 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.441011 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.441087 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.443536 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.443537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.443538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.443544 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.445207 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.445668 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.445669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.445670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.445729 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.446006 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.446008 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.446008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.446134 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.446222 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.446478 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.446557 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 10:06:52.446852 2231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.437883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:36091 (local address 127.0.0.1:37238)
0811 10:06:52.438061 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.438105 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.438361 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.438589 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.438592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.438876 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.439036 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.439040 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.439698 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.439699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.440606 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.440609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.441110 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.441111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.441250 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.441926 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.441934 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.443447 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.445311 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.445319 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.445321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.445589 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.445808 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.445809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.445809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.445936 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.446214 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.446222 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.446350 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.446442 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.446589 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":110,"threads_started":1}
I20260811 10:06:52.447098 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.437487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60562 (local address 127.9.127.252:41337)
0811 10:06:52.437678 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.437688 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.437722 (+ 34us) server_negotiation.cc:407] Connection header received
0811 10:06:52.438359 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.438368 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.438392 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.438507 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.439194 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.440167 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.441059 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.441529 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.441608 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.443970 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.443978 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.443979 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.443986 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.445529 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.445876 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.445883 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.445883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.445955 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.446177 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.446178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.446178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.446350 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.446487 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.446585 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.446662 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
I20260811 10:06:52.447480 2227 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:52.450354 2063 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } attempt: 2
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:52.454989 2231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.447734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:38137 (local address 127.0.0.1:38930)
0811 10:06:52.447840 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.447851 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.447890 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.448099 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.448100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.448234 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.448268 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.448270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.448962 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.448963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.449461 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.449462 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.449852 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.449853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.449918 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.450282 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.450286 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.452156 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.453848 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.453849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.453850 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.454022 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.454239 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.454240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.454240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.454302 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.454602 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.454602 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.454650 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.454746 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.454854 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 10:06:52.455060 2149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.447794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38930 (local address 127.9.127.253:38137)
0811 10:06:52.447845 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.447847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.447879 (+ 32us) server_negotiation.cc:407] Connection header received
0811 10:06:52.447976 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.447977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.447990 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.448042 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.448351 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.448865 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.449549 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.449777 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.449855 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.452256 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.452257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.452257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.452264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.453747 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.454102 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.454104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.454104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.454164 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.454374 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.454375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.454375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.454492 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.454570 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.454826 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.454932 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:06:52.455386 2227 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:52.455718 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.447968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37252 (local address 127.9.127.254:36091)
0811 10:06:52.448010 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.448012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.448019 (+ 7us) server_negotiation.cc:407] Connection header received
0811 10:06:52.448038 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.448039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.448046 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.448095 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.448502 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.448996 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.449661 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.449848 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.449928 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.452277 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.452278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.452279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.452285 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.454323 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.454730 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.454731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.454731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.454809 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.455056 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.455057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.455058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.455181 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.455322 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.455551 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.455628 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 10:06:52.458426 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.450590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60564)
0811 10:06:52.450639 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.450648 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.450683 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.450860 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.450862 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.451044 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.451093 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.451095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.451797 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.451798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.452558 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.452561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.453077 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.453078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.453522 (+ 444us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.453890 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.453895 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.455456 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.457346 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.457347 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.457348 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.457596 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.457815 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.457816 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.457817 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.457886 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.458169 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.458170 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.458211 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.458258 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.458353 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 10:06:52.458766 2230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.450633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60564 (local address 127.9.127.252:41337)
0811 10:06:52.450754 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.450756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.450764 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:06:52.450784 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.450785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.450794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.450848 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.451196 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.451719 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.452648 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.452991 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.453067 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.455547 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.455548 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.455549 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.455555 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.457250 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.457681 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.457682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.457682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.457740 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.457967 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.457968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.457968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.458087 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.458552 (+ 465us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.458604 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.458679 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:06:52.461140 2063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9: Bootstrap starting.
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
I20260811 10:06:52.462028 2063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:52.462388 2063 log.cc:824] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:52.463362 2063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9: No bootstrap required, opened a new log
I20260811 10:06:52.464111 2231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.455617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60568)
0811 10:06:52.455817 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.455827 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.455867 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.455994 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.455994 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.456223 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.456253 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.456255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.457429 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.457430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.458066 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.458068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.458505 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.458507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.458567 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.459262 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.459268 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.460710 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.462777 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.462778 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.462778 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.462973 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.463361 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.463362 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.463362 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.463429 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.463764 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.463765 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.463811 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.463895 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.464018 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186}
I20260811 10:06:52.464507 2233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.455688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60568 (local address 127.9.127.252:41337)
0811 10:06:52.455842 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.455843 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.455854 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:06:52.455925 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.455926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.455934 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.456030 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.456515 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.457337 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.458140 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.458423 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.458487 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.460825 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.460827 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.460827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.460834 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.462697 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.463058 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.463059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.463060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.463123 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.463523 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.463523 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.463524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.463683 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.463750 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.463935 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.464401 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":378,"server-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260811 10:06:52.465314 2149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.456871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38936 (local address 127.9.127.253:38137)
0811 10:06:52.456904 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.456906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.456943 (+ 37us) server_negotiation.cc:407] Connection header received
0811 10:06:52.457012 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.457013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.457022 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.457069 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.457558 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.458216 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.459398 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.459648 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.459734 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.462193 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.462194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.462195 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.462201 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.463990 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.464338 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.464339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.464340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.464398 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.464765 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.464766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.464767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.464933 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.465112 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.465147 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.465216 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:06:52.465785 2063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } }
I20260811 10:06:52.465876 2227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576: Bootstrap starting.
I20260811 10:06:52.465925 2063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be4f3ac1a354c189d776525213f28e9, State: Initialized, Role: FOLLOWER
I20260811 10:06:52.466001 2063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } }
I20260811 10:06:52.466298 2235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.466406 2235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:52.466444 2063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:52.466602 2227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:52.466734 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:52.466917 2227 log.cc:824] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:52.467733 2227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576: No bootstrap required, opened a new log
I20260811 10:06:52.467746 2036 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3be4f3ac1a354c189d776525213f28e9"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37252
I20260811 10:06:52.467864 2036 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 10:06:52.467931 2036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:52.468638 2036 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } }
I20260811 10:06:52.468922 2036 leader_election.cc:288] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6506ed034b404c917cef3aa5930e23 (127.9.127.253:38137), 3c5621db1aa448a7bce995ccc4af6576 (127.9.127.252:41337)
I20260811 10:06:52.469683 2227 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } }
I20260811 10:06:52.469828 2227 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c5621db1aa448a7bce995ccc4af6576, State: Initialized, Role: FOLLOWER
I20260811 10:06:52.469913 2227 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } }
W20260811 10:06:52.470144 2249 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:52.470189 2249 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:52.470249 2227 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:52.470516 2198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3be4f3ac1a354c189d776525213f28e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3c5621db1aa448a7bce995ccc4af6576"
I20260811 10:06:52.470629 2198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:52.471458 2198 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be4f3ac1a354c189d776525213f28e9 in term 1.
I20260811 10:06:52.473042 2008 leader_election.cc:302] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be4f3ac1a354c189d776525213f28e9, 3c5621db1aa448a7bce995ccc4af6576; no voters:
I20260811 10:06:52.473256 2235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:52.473399 2235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [term 1 LEADER]: Becoming Leader. State: Replica: 3be4f3ac1a354c189d776525213f28e9, State: Running, Role: LEADER
I20260811 10:06:52.473488 2235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } }
W20260811 10:06:52.473596 2273 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:52.473645 2273 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:52.473825 2257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.473888 2257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:52.473841 2235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3be4f3ac1a354c189d776525213f28e9. Latest consensus state: current_term: 1 leader_uuid: "3be4f3ac1a354c189d776525213f28e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.473944 2235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:52.475847 2152 master_runner.cc:186] Error getting master registration for 127.9.127.253:38137: OK, instance_id { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" instance_seqno: 1786442812275387 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 10:06:52.478570 2152 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 10:06:52.478727 2277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:52.478924 2277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:52.479655 2149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.470024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38950 (local address 127.9.127.253:38137)
0811 10:06:52.470061 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.470063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.470982 (+ 919us) server_negotiation.cc:407] Connection header received
0811 10:06:52.471074 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.471075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.471086 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.471114 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.471976 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.472640 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.473906 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.474768 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.474813 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.476447 (+ 1634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.476448 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.476449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.476455 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.478380 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.478817 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.478819 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.478819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.478874 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.479103 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.479104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.479104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.479225 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.479293 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.479492 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.479567 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:06:52.470695 1988 master_runner.cc:186] Error getting master registration for 127.9.127.253:38137: OK, instance_id { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" instance_seqno: 1786442812275387 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 10:06:52.479854 1988 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 10:06:52.481868 2198 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [term 1 FOLLOWER]: Refusing update from remote peer 3be4f3ac1a354c189d776525213f28e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:52.482161 2235 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:52.483053 2233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.470371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60574 (local address 127.9.127.252:41337)
0811 10:06:52.470411 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.470412 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.474051 (+ 3639us) server_negotiation.cc:407] Connection header received
0811 10:06:52.474149 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.474150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.474160 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.474188 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.474935 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.475634 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.476657 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.477018 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.477056 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.479398 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.479399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.479399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.479406 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.481253 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.481701 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.481702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.481702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.481768 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.482284 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.482285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.482285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.482451 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.482546 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.482880 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.482969 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:06:52.483644 2257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3be4f3ac1a354c189d776525213f28e9. Latest consensus state: current_term: 1 leader_uuid: "3be4f3ac1a354c189d776525213f28e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.483776 2257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:52.486188 2235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3be4f3ac1a354c189d776525213f28e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.486270 2235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:52.486555 2278 mvcc.cc:205] Tried to move back new op lower bound from 7317269759923253248 to 7317269759892008960. Current Snapshot: MvccSnapshot[applied={T|T < 7317269759923253248}]
I20260811 10:06:52.486822 2257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3be4f3ac1a354c189d776525213f28e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.486912 2257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:52.487514 2277 catalog_manager.cc:1347] Generated new cluster ID: e25a327b8d52467cb117a0c4594185ab
I20260811 10:06:52.487308 2279 mvcc.cc:205] Tried to move back new op lower bound from 7317269759923253248 to 7317269759892008960. Current Snapshot: MvccSnapshot[applied={T|T < 7317269759923253248 or (T in {7317269759923253248})}]
I20260811 10:06:52.487562 2277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:52.491231 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.470691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37258 (local address 127.9.127.254:36091)
0811 10:06:52.470728 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.470730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.476904 (+ 6174us) server_negotiation.cc:407] Connection header received
0811 10:06:52.476997 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.476998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.477009 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.477041 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.484877 (+ 7836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.485568 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.486631 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.486932 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.486979 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.488528 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.488530 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.488530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.488537 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.490162 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.490515 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.490516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.490516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.490563 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.490727 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.490728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.490728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.490830 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.490898 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.491082 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.491148 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:06:52.497820 2277 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:52.499119 2277 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:52.509865 2144 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } attempt: 3
I20260811 10:06:52.514696 2277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9: Generated new TSK 0
I20260811 10:06:52.514884 2277 catalog_manager.cc:1514] Initializing in-progress tserver states...
Aug 11 10:06:52 dist-test-slave-1x4g krb5kdc[1975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442812, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:06:52.518666 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.510111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41337 (local address 127.0.0.1:60588)
0811 10:06:52.510161 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:52.510173 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:52.510214 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:52.510396 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:52.510397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:52.510582 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:52.510625 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.510627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.511544 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.511545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.512291 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:52.512293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.512841 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.512842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:52.512895 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.514243 (+ 1348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:52.514249 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:52.515727 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:52.517590 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.517591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.517591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.517815 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.518036 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:52.518037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:52.518037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:52.518091 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:52.518342 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:52.518343 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:52.518386 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 10:06:52.518471 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 10:06:52.518567 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 10:06:52.519134 2233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:52.510164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60588 (local address 127.9.127.252:41337)
0811 10:06:52.510203 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.510206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.510214 (+ 8us) server_negotiation.cc:407] Connection header received
0811 10:06:52.510282 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.510282 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.510291 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.510330 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.510696 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.511410 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.512405 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:52.512709 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:52.512766 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:52.515817 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:52.515818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:52.515819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:52.515825 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:52.517509 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.517906 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.517907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.517908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.517970 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:52.518139 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:52.518139 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:52.518140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:52.518271 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:52.518338 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:52.518928 (+ 590us) server_negotiation.cc:299] Negotiation successful
0811 10:06:52.519042 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:06:52.520720 2144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23: Bootstrap starting.
I20260811 10:06:52.521522 2144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:52.521850 2144 log.cc:824] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:52.522745 2144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23: No bootstrap required, opened a new log
I20260811 10:06:52.529578 2144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } }
I20260811 10:06:52.529729 2144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6506ed034b404c917cef3aa5930e23, State: Initialized, Role: FOLLOWER
I20260811 10:06:52.529817 2144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } }
I20260811 10:06:52.530155 2144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:52.530258 2116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:52.531313 2116 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [term 1 FOLLOWER]: Refusing update from remote peer 3be4f3ac1a354c189d776525213f28e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:52.531651 2283 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:52.532217 2117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3be4f3ac1a354c189d776525213f28e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6e6506ed034b404c917cef3aa5930e23"
I20260811 10:06:52.533185 2117 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be4f3ac1a354c189d776525213f28e9 in term 1.
W20260811 10:06:52.535082 2299 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:52.535132 2299 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:52.536478 2302 mvcc.cc:205] Tried to move back new op lower bound from 7317269760053276672 to 7317269759892008960. Current Snapshot: MvccSnapshot[applied={T|T < 7317269759923253248}]
I20260811 10:06:52.537047 2301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3be4f3ac1a354c189d776525213f28e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.537189 2301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:52.537282 2301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3be4f3ac1a354c189d776525213f28e9. Latest consensus state: current_term: 1 leader_uuid: "3be4f3ac1a354c189d776525213f28e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.537379 2301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:52.537452 2301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3be4f3ac1a354c189d776525213f28e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:52.537550 2301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 10:06:52.554026 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.552504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.9.127.253:38137)
0811 10:06:52.552545 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.552547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.553317 (+ 770us) server_negotiation.cc:407] Connection header received
0811 10:06:52.553425 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.553426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.553437 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.553468 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.553936 (+ 468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38952: BlockingRecv error: recv got EOF from 127.0.0.1:38952 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 10:06:52.554957 2066 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.552363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37270 (local address 127.9.127.254:36091)
0811 10:06:52.552440 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.552442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.554389 (+ 1947us) server_negotiation.cc:407] Connection header received
0811 10:06:52.554487 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.554488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.554498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.554526 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.554891 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37270: BlockingRecv error: recv got EOF from 127.0.0.1:37270 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 10:06:52.555874 2233 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.552966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60594 (local address 127.9.127.252:41337)
0811 10:06:52.553008 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.553010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.555317 (+ 2307us) server_negotiation.cc:407] Connection header received
0811 10:06:52.555451 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.555452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.555462 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.555490 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.555813 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60594: BlockingRecv error: recv got EOF from 127.0.0.1:60594 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 10:06:52.558353 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.557630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38966 (local address 127.9.127.253:38137)
0811 10:06:52.557664 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.557666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.557846 (+ 180us) server_negotiation.cc:407] Connection header received
0811 10:06:52.557951 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.557952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.557970 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.557999 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.558306 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38966: BlockingRecv error: recv got EOF from 127.0.0.1:38966 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 10:06:52.561419 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.560649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38982 (local address 127.9.127.253:38137)
0811 10:06:52.560681 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.560682 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.560946 (+ 264us) server_negotiation.cc:407] Connection header received
0811 10:06:52.561040 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.561041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.561051 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.561079 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.561375 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38982: BlockingRecv error: recv got EOF from 127.0.0.1:38982 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 10:06:52.565382 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.564603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38984 (local address 127.9.127.253:38137)
0811 10:06:52.564636 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.564638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.564910 (+ 272us) server_negotiation.cc:407] Connection header received
0811 10:06:52.565011 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.565012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.565021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.565047 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.565341 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38984: BlockingRecv error: recv got EOF from 127.0.0.1:38984 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 10:06:52.571300 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.570564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38994 (local address 127.9.127.253:38137)
0811 10:06:52.570611 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.570613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.570830 (+ 217us) server_negotiation.cc:407] Connection header received
0811 10:06:52.570922 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.570923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.570932 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.570960 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.571257 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38994: BlockingRecv error: recv got EOF from 127.0.0.1:38994 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 10:06:52.581481 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.580623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39006 (local address 127.9.127.253:38137)
0811 10:06:52.580661 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.580663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.580948 (+ 285us) server_negotiation.cc:407] Connection header received
0811 10:06:52.581049 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.581050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.581060 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.581090 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.581421 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39006: BlockingRecv error: recv got EOF from 127.0.0.1:39006 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 10:06:52.599972 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.599004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39012 (local address 127.9.127.253:38137)
0811 10:06:52.599048 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.599050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.599334 (+ 284us) server_negotiation.cc:407] Connection header received
0811 10:06:52.599442 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.599443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.599456 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.599486 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.599909 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39012: BlockingRecv error: recv got EOF from 127.0.0.1:39012 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 10:06:52.634653 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.633618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39016 (local address 127.9.127.253:38137)
0811 10:06:52.633668 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.633670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.633998 (+ 328us) server_negotiation.cc:407] Connection header received
0811 10:06:52.634115 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.634116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.634129 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.634161 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.634592 (+ 431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39016: BlockingRecv error: recv got EOF from 127.0.0.1:39016 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 10:06:52.701274 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.700302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39032 (local address 127.9.127.253:38137)
0811 10:06:52.700375 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.700418 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.700560 (+ 142us) server_negotiation.cc:407] Connection header received
0811 10:06:52.700682 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.700683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.700695 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.700743 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.701199 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39032: BlockingRecv error: recv got EOF from 127.0.0.1:39032 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 10:06:52.831530 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:52.830630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39046 (local address 127.9.127.253:38137)
0811 10:06:52.830708 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:52.830710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:52.830932 (+ 222us) server_negotiation.cc:407] Connection header received
0811 10:06:52.831012 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:52.831013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:52.831026 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:52.831072 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:52.831464 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39046: BlockingRecv error: recv got EOF from 127.0.0.1:39046 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 10:06:53.089649 2149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:53.088946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39052 (local address 127.9.127.253:38137)
0811 10:06:53.089017 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:53.089019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:53.089029 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:53.089127 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:53.089128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:53.089141 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:53.089211 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:53.089559 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39052: BlockingRecv error: recv got EOF from 127.0.0.1:39052 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 10:06:53.114359 2367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3be4f3ac1a354c189d776525213f28e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be4f3ac1a354c189d776525213f28e9" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 36091 } } peers { permanent_uuid: "6e6506ed034b404c917cef3aa5930e23" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 38137 } } peers { permanent_uuid: "3c5621db1aa448a7bce995ccc4af6576" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41337 } } }
I20260811 10:06:53.114547 2367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be4f3ac1a354c189d776525213f28e9 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:53.474112 2273 catalog_manager.cc:1259] Loaded cluster ID: e25a327b8d52467cb117a0c4594185ab
I20260811 10:06:53.474195 2273 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576: loading cluster ID for follower catalog manager: success
I20260811 10:06:53.475050 2273 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576: acquiring CA information for follower catalog manager: success
I20260811 10:06:53.475382 2273 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3c5621db1aa448a7bce995ccc4af6576: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 10:06:53.535622 2299 catalog_manager.cc:1259] Loaded cluster ID: e25a327b8d52467cb117a0c4594185ab
I20260811 10:06:53.535727 2299 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23: loading cluster ID for follower catalog manager: success
I20260811 10:06:53.536563 2299 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23: acquiring CA information for follower catalog manager: success
I20260811 10:06:53.536911 2299 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6e6506ed034b404c917cef3aa5930e23: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 10:06:53.605548 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:53.602849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.9.127.253:38137)
0811 10:06:53.602993 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:53.602996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:53.603011 (+ 15us) server_negotiation.cc:407] Connection header received
0811 10:06:53.603070 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:53.603071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:53.603105 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:53.603192 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:53.603328 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.603853 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.604656 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.604918 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.604990 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:53.605175 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:53.605295 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:53.605379 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:53.605419 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 10:06:53.605449 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"spinlock_wait_cycles":16640,"thread_start_us":112,"threads_started":1}
I20260811 10:06:53.609686 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:53.607393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60598 (local address 127.9.127.252:41337)
0811 10:06:53.607519 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:53.607521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:53.607561 (+ 40us) server_negotiation.cc:407] Connection header received
0811 10:06:53.607629 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:53.607629 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:53.607665 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:53.607731 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:53.607823 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.608287 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.609015 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.609207 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.609254 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:53.609371 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:53.609470 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:53.609524 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:53.609556 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 10:06:53.609573 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
I20260811 10:06:53.614050 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:53.611183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39064 (local address 127.9.127.253:38137)
0811 10:06:53.611229 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:53.611231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:53.611339 (+ 108us) server_negotiation.cc:407] Connection header received
0811 10:06:53.611442 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:53.611443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:53.611454 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:53.611484 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:53.611699 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.612269 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.613246 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.613557 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.613595 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:53.613769 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:53.613802 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:53.613870 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:53.613937 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 10:06:53.613958 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 10:06:53.614491 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:53.611546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60606 (local address 127.9.127.252:41337)
0811 10:06:53.611587 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:53.611589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:53.611722 (+ 133us) server_negotiation.cc:407] Connection header received
0811 10:06:53.611789 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:53.611790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:53.611800 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:53.611847 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:53.611971 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.612666 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.613469 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.613808 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.613871 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:53.614061 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:53.614092 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:53.614123 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:53.614358 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 10:06:53.614388 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 10:06:53.614588 2396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:53.611243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37276 (local address 127.9.127.254:36091)
0811 10:06:53.611362 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:53.611364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:53.611374 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:53.611457 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:53.611458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:53.611519 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:53.611599 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:53.611781 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.612574 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.613601 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:53.613910 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:53.613968 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:53.614219 (+ 251us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:53.614333 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:53.614388 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:53.614472 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 10:06:53.614501 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":63,"threads_started":1}
I20260811 10:06:53.616217 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 1988
I20260811 10:06:53.626807 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 2070
I20260811 10:06:53.633760 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 2152
2026-08-11T10:06:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2865 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 10:06:53 dist-test-slave-1x4g krb5kdc[2400](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 10:06:53 dist-test-slave-1x4g krb5kdc[2400](info): set up 2 sockets
Aug 11 10:06:53 dist-test-slave-1x4g krb5kdc[2400](info): commencing operation
krb5kdc: starting...
W20260811 10:06:54.741890 9727 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/test-user.keytab.
Aug 11 10:06:54 dist-test-slave-1x4g krb5kdc[2400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T10:06:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T10:06:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.9.127.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
Entry for principal kudu/127.9.127.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab.
I20260811 10:06:54.864524 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:42369
--webserver_interface=127.9.127.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:42369,127.9.127.253:35337,127.9.127.252:41145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 10:06:54.947983 2415 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 10:06:54.948247 2415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:54.948282 2415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:54.948326 2415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:54.949487 2415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:54.949558 2415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:54.949582 2415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:54.949604 2415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:54.949633 2415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:54.951112 2415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:42369,127.9.127.253:35337,127.9.127.252:41145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.254.keytab
--principal=kudu/127.9.127.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.254:42369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.127.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:54.951388 2415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:54.951658 2415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:54.956477 2423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:54.956543 2422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:54.956472 2426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:54.956691 2415 server_base.cc:1034] running on GCE node
I20260811 10:06:54.957000 2415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:54.957329 2415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:54.958493 2415 hybrid_clock.cc:648] HybridClock initialized: now 1786442814958487 us; error 35 us; skew 500 ppm
Aug 11 10:06:54 dist-test-slave-1x4g krb5kdc[2400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442814, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:54.961011 2415 init.cc:377] Logged in from keytab as kudu/127.9.127.254@KRBTEST.COM (short username kudu)
I20260811 10:06:54.961449 2415 webserver.cc:460] Webserver started at http://127.9.127.254:40667/ using document root <none> and password file <none>
I20260811 10:06:54.961692 2415 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:54.961757 2415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:54.961902 2415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:54.962971 2415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/data/instance:
uuid: "540d28cd277b45d8be7a30cefa015f89"
format_stamp: "Formatted at 2026-08-11 10:06:54 on dist-test-slave-1x4g"
server_key: "e8d9aca2884994f4c0464ae6621221b6"
server_key_iv: "dfbcf1aee045a7d6459c186134f6dd47"
server_key_version: "encryptionkey@0"
I20260811 10:06:54.963352 2415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/wal/instance:
uuid: "540d28cd277b45d8be7a30cefa015f89"
format_stamp: "Formatted at 2026-08-11 10:06:54 on dist-test-slave-1x4g"
server_key: "e8d9aca2884994f4c0464ae6621221b6"
server_key_iv: "dfbcf1aee045a7d6459c186134f6dd47"
server_key_version: "encryptionkey@0"
I20260811 10:06:54.964682 2415 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 10:06:54.965461 2434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:54.965626 2415 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 10:06:54.965730 2415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/wal
uuid: "540d28cd277b45d8be7a30cefa015f89"
format_stamp: "Formatted at 2026-08-11 10:06:54 on dist-test-slave-1x4g"
server_key: "e8d9aca2884994f4c0464ae6621221b6"
server_key_iv: "dfbcf1aee045a7d6459c186134f6dd47"
server_key_version: "encryptionkey@0"
I20260811 10:06:54.965806 2415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:54.973260 2415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:54.975035 2415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:54.975193 2415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:54.979331 2415 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.254:42369
I20260811 10:06:54.979374 2487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.254:42369 every 8 connection(s)
I20260811 10:06:54.979737 2415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/data/info.pb
I20260811 10:06:54.980720 2488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:54.982329 2488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:06:54 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442814, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:54.989116 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 2415
I20260811 10:06:54.989239 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-0/wal/instance
I20260811 10:06:54.989485 9727 external_mini_cluster.cc:1428] Setting key c2f38688a263bedeea6c60cc48380b9c
I20260811 10:06:54.991986 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:54.982986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44108 (local address 127.9.127.254:42369)
0811 10:06:54.983711 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:54.983714 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:54.983725 (+ 11us) server_negotiation.cc:407] Connection header received
0811 10:06:54.983784 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:54.983786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:54.983800 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:54.983862 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:54.984382 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:54.985289 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:54.986155 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:54.986482 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:54.986560 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:54.988469 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:54.988476 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:54.988476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:54.988482 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:54.990410 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:54.990758 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:54.990761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:54.990762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:54.990871 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:54.991096 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:54.991096 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:54.991097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:54.991389 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:54.991484 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:54.991704 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 10:06:54.991822 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":705,"thread_start_us":67,"threads_started":1}
I20260811 10:06:54.992092 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:54.982924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42369 (local address 127.0.0.1:44108)
0811 10:06:54.983113 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:54.983146 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:54.983582 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:54.983895 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:54.983898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:54.984139 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:54.984291 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:54.984295 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:54.985384 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:54.985385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:54.986063 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:54.986066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:54.986572 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:54.986573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:54.986625 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:54.987066 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:54.987083 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:54.988392 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:54.990489 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:54.990496 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:54.990498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:54.990680 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:54.990942 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:54.990942 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:54.990943 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:54.991017 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:54.991471 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:54.991478 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:54.991560 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 10:06:54.991666 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 10:06:54.991909 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":74,"thread_start_us":99,"threads_started":1}
I20260811 10:06:54.992856 2488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:54.993219 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:54.993113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52438)
0811 10:06:54.993158 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:54.993202 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 10:06:54.993376 2438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
I20260811 10:06:54.993770 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:54.993692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52454)
0811 10:06:54.993730 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:54.993755 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 10:06:54.993883 2488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:35337: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.9.127.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab.
Entry for principal kudu/127.9.127.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab.
I20260811 10:06:55.013751 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.253:35337
--webserver_interface=127.9.127.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab
--principal=kudu/127.9.127.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:42369,127.9.127.253:35337,127.9.127.252:41145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:06:55.043134 2488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } attempt: 1
I20260811 10:06:55.043720 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.043580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52456)
0811 10:06:55.043642 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.043684 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 10:06:55.044100 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.044010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52460)
0811 10:06:55.044051 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.044081 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 10:06:55.044219 2488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:35337: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
W20260811 10:06:55.094909 2496 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 10:06:55.095110 2496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:55.095127 2496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:55.095146 2496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:55.096227 2496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:55.096268 2496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:55.096282 2496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:55.096334 2496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:55.096359 2496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:55.097892 2496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:42369,127.9.127.253:35337,127.9.127.252:41145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.253.keytab
--principal=kudu/127.9.127.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.253:35337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.127.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:55.098133 2496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:55.098347 2496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 10:06:55.103148 2496 server_base.cc:1034] running on GCE node
W20260811 10:06:55.103171 2503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:55.103255 2502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:55.103183 2506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:55.103554 2496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:55.103832 2496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:55.104969 2496 hybrid_clock.cc:648] HybridClock initialized: now 1786442815104962 us; error 29 us; skew 500 ppm
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:55.107327 2496 init.cc:377] Logged in from keytab as kudu/127.9.127.253@KRBTEST.COM (short username kudu)
I20260811 10:06:55.107755 2496 webserver.cc:460] Webserver started at http://127.9.127.253:39865/ using document root <none> and password file <none>
I20260811 10:06:55.107932 2496 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:55.107973 2496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:55.108074 2496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:55.109124 2496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/data/instance:
uuid: "aa0e5614b80d44edbd639f788ac8a170"
format_stamp: "Formatted at 2026-08-11 10:06:55 on dist-test-slave-1x4g"
server_key: "c2a086bfb15e1a8f3cf22784c3fbfd9e"
server_key_iv: "3e3f39d9c3d34def878a59aac6614556"
server_key_version: "encryptionkey@0"
I20260811 10:06:55.109441 2496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/wal/instance:
uuid: "aa0e5614b80d44edbd639f788ac8a170"
format_stamp: "Formatted at 2026-08-11 10:06:55 on dist-test-slave-1x4g"
server_key: "c2a086bfb15e1a8f3cf22784c3fbfd9e"
server_key_iv: "3e3f39d9c3d34def878a59aac6614556"
server_key_version: "encryptionkey@0"
I20260811 10:06:55.110747 2496 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 10:06:55.111387 2513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:55.111553 2496 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 10:06:55.111642 2496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/wal
uuid: "aa0e5614b80d44edbd639f788ac8a170"
format_stamp: "Formatted at 2026-08-11 10:06:55 on dist-test-slave-1x4g"
server_key: "c2a086bfb15e1a8f3cf22784c3fbfd9e"
server_key_iv: "3e3f39d9c3d34def878a59aac6614556"
server_key_version: "encryptionkey@0"
I20260811 10:06:55.111721 2496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:55.112373 2488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } attempt: 2
I20260811 10:06:55.112744 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.112608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52472)
0811 10:06:55.112669 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.112708 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 10:06:55.113123 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.113026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52484)
0811 10:06:55.113069 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.113102 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 10:06:55.113253 2488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.253:35337: Network error: Client connection negotiation failed: client connection to 127.9.127.253:35337: connect: Connection refused (error 111)
I20260811 10:06:55.129719 2496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:55.131461 2496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:55.131573 2496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:55.135784 2496 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.253:35337
I20260811 10:06:55.135834 2574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.253:35337 every 8 connection(s)
I20260811 10:06:55.136224 2496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/data/info.pb
I20260811 10:06:55.137225 2575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:55.138195 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 2496
I20260811 10:06:55.138314 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-1/wal/instance
I20260811 10:06:55.138545 9727 external_mini_cluster.cc:1428] Setting key e88aac959b7430a516d80daee9d1d7b4
I20260811 10:06:55.139321 2575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.9.127.252@KRBTEST.COM; defaulting to no policy
I20260811 10:06:55.148738 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.140202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44116 (local address 127.9.127.254:42369)
0811 10:06:55.140269 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.140271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.140460 (+ 189us) server_negotiation.cc:407] Connection header received
0811 10:06:55.141029 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.141030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.141043 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.141093 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.141734 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.142234 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.143188 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.143384 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.143470 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.146027 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.146028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.146028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.146035 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.147528 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.147900 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.147900 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.147901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.147950 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.148165 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.148166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.148166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.148281 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.148331 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.148590 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.148671 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 10:06:55.148947 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.140146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42369 (local address 127.0.0.1:44116)
0811 10:06:55.140330 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.140371 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:55.140911 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:55.141159 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:55.141163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:55.141427 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:55.141636 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.141640 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.142325 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.142326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.143094 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.143096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.143498 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.143499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.143637 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.144200 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:55.144209 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:55.145926 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:55.147610 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.147617 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.147619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.147834 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.148005 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.148006 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.148006 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.148114 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.148332 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:55.148338 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:55.148477 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 10:06:55.148566 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 10:06:55.148717 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260811 10:06:55.149545 2575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.9.127.252@KRBTEST.COM" created.
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
I20260811 10:06:55.157564 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.149902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52492 (local address 127.9.127.253:35337)
0811 10:06:55.150043 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.150047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.150063 (+ 16us) server_negotiation.cc:407] Connection header received
0811 10:06:55.150083 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.150085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.150101 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.150178 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.150501 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.151170 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.152055 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.152580 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.152665 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.154679 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.154687 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.154688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.154694 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.156264 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.156680 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.156682 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.156682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.156736 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.156959 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.156960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.156960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.157098 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.157162 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.157330 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.157459 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
I20260811 10:06:55.157585 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.149838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52492)
0811 10:06:55.149869 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.149880 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:55.149920 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:55.150180 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:55.150181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:55.150347 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:55.150406 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.150408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.151258 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.151259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.151977 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.151979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.152661 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.152661 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.152716 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.153149 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:55.153154 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:55.154594 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:55.156348 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.156349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.156349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.156588 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.156823 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.156824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.156825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.156895 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.157169 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:55.157170 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:55.157220 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 10:06:55.157309 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 10:06:55.157415 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260811 10:06:55.159353 2575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:55.159749 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.159648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47428)
0811 10:06:55.159688 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.159730 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 10:06:55.159883 2517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
I20260811 10:06:55.160313 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.160220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47440)
0811 10:06:55.160271 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.160297 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 10:06:55.160422 2575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41145: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.9.127.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab.
Entry for principal kudu/127.9.127.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab.
I20260811 10:06:55.165602 9727 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskwRyaEw/build/release/bin/kudu
/tmp/dist-test-taskwRyaEw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.252:41145
--webserver_interface=127.9.127.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab
--principal=kudu/127.9.127.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.9.127.212:45723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.127.254:42369,127.9.127.253:35337,127.9.127.252:41145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 10:06:55.204501 2488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } attempt: 3
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442814, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
I20260811 10:06:55.209643 2575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } attempt: 1
I20260811 10:06:55.210052 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.209899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47452)
0811 10:06:55.209968 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.210009 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 10:06:55.210716 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.210606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47456)
0811 10:06:55.210655 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.210686 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 10:06:55.210855 2575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41145: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
I20260811 10:06:55.212180 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.205049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52500 (local address 127.9.127.253:35337)
0811 10:06:55.205124 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.205127 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.205156 (+ 29us) server_negotiation.cc:407] Connection header received
0811 10:06:55.205185 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.205186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.205203 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.205260 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.205602 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.206085 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.206793 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.207020 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.207093 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.209328 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.209329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.209329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.209338 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.211078 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.211413 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.211415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.211415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.211469 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.211674 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.211675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.211675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.211789 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.211856 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.212023 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.212099 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 10:06:55.212193 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.204961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52500)
0811 10:06:55.205027 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.205044 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:55.205119 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:55.205269 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:55.205270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:55.205442 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:55.205507 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.205509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.206179 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.206180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.206696 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.206698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.207094 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.207095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.207181 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.207709 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:55.207714 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:55.209228 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:55.211157 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.211158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.211158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.211330 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.211536 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.211537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.211537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.211597 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.211847 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:55.211848 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:55.211896 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 10:06:55.211985 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 10:06:55.212102 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 10:06:55.212618 2488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:55.212984 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.212873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47458)
0811 10:06:55.212936 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.212963 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 10:06:55.213299 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.213227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47474)
0811 10:06:55.213256 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.213279 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260811 10:06:55.213387 2488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41145: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
I20260811 10:06:55.244627 2488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } attempt: 1
I20260811 10:06:55.245127 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.244988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47488)
0811 10:06:55.245051 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.245099 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 10:06:55.245571 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.245488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47494)
0811 10:06:55.245531 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.245555 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 10:06:55.245676 2488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41145: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
W20260811 10:06:55.249630 2583 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 10:06:55.249815 2583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 10:06:55.249832 2583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 10:06:55.249851 2583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 10:06:55.251010 2583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 10:06:55.251051 2583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 10:06:55.251065 2583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 10:06:55.251078 2583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 10:06:55.251091 2583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 10:06:55.252524 2583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.127.212:45723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.9.127.254:42369,127.9.127.253:35337,127.9.127.252:41145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/krb5kdc/kudu_127.9.127.252.keytab
--principal=kudu/127.9.127.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.127.252:41145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.127.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 08:54:39 UTC on ccycloud.quasar-rkjucd.root.comops.site
build id 4579928
I20260811 10:06:55.252708 2583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 10:06:55.252940 2583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 10:06:55.257624 2590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:55.257598 2592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 10:06:55.257643 2589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 10:06:55.257856 2583 server_base.cc:1034] running on GCE node
I20260811 10:06:55.258173 2583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 10:06:55.258442 2583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 10:06:55.259589 2583 hybrid_clock.cc:648] HybridClock initialized: now 1786442815259570 us; error 34 us; skew 500 ppm
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 10:06:55.262264 2583 init.cc:377] Logged in from keytab as kudu/127.9.127.252@KRBTEST.COM (short username kudu)
I20260811 10:06:55.262717 2583 webserver.cc:460] Webserver started at http://127.9.127.252:33741/ using document root <none> and password file <none>
I20260811 10:06:55.262929 2583 fs_manager.cc:359] Metadata directory not provided
I20260811 10:06:55.262970 2583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 10:06:55.263064 2583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 10:06:55.264096 2583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/data/instance:
uuid: "4106d87cb6bf497daf757d577e4f9b53"
format_stamp: "Formatted at 2026-08-11 10:06:55 on dist-test-slave-1x4g"
server_key: "037c560731c4f7142904eb485b68500a"
server_key_iv: "25f601d4391f0a05b97ce51cf637b5c7"
server_key_version: "encryptionkey@0"
I20260811 10:06:55.264389 2583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/wal/instance:
uuid: "4106d87cb6bf497daf757d577e4f9b53"
format_stamp: "Formatted at 2026-08-11 10:06:55 on dist-test-slave-1x4g"
server_key: "037c560731c4f7142904eb485b68500a"
server_key_iv: "25f601d4391f0a05b97ce51cf637b5c7"
server_key_version: "encryptionkey@0"
I20260811 10:06:55.265790 2583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 10:06:55.266484 2600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:55.266651 2583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 10:06:55.266738 2583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/data,/tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/wal
uuid: "4106d87cb6bf497daf757d577e4f9b53"
format_stamp: "Formatted at 2026-08-11 10:06:55 on dist-test-slave-1x4g"
server_key: "037c560731c4f7142904eb485b68500a"
server_key_iv: "25f601d4391f0a05b97ce51cf637b5c7"
server_key_version: "encryptionkey@0"
I20260811 10:06:55.266821 2583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 10:06:55.279008 2575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } attempt: 2
I20260811 10:06:55.279564 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.279423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47500)
0811 10:06:55.279490 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.279531 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 10:06:55.279892 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.279804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47504)
0811 10:06:55.279845 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.279874 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 10:06:55.279978 2575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.127.252:41145: Network error: Client connection negotiation failed: client connection to 127.9.127.252:41145: connect: Connection refused (error 111)
I20260811 10:06:55.298545 2583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 10:06:55.300995 2583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 10:06:55.301147 2583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 10:06:55.305299 2583 rpc_server.cc:307] RPC server started. Bound to: 127.9.127.252:41145
I20260811 10:06:55.305352 2657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.127.252:41145 every 8 connection(s)
I20260811 10:06:55.305727 2583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/data/info.pb
I20260811 10:06:55.306689 2659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 10:06:55.308256 2659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:55.310812 9727 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskwRyaEw/build/release/bin/kudu as pid 2583
I20260811 10:06:55.310935 9727 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskwRyaEw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786442543469380-9727-0/minicluster-data/master-2/wal/instance
I20260811 10:06:55.311123 9727 external_mini_cluster.cc:1428] Setting key 29567c2d1beedd3e032ec16271427a20
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:06:55.318591 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.308996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44122 (local address 127.9.127.254:42369)
0811 10:06:55.309084 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.309086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.309297 (+ 211us) server_negotiation.cc:407] Connection header received
0811 10:06:55.309799 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.309800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.309814 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.309872 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.310486 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.311037 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.312581 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.312894 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.312970 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.315571 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.315573 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.315573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.315582 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.317130 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.317576 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.317578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.317578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.317643 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.317903 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.317904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.317904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.318063 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.318137 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.318397 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.318502 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 10:06:55.318750 2661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.308973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.254:42369 (local address 127.0.0.1:44122)
0811 10:06:55.309177 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.309213 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:55.309691 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:55.309944 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:55.309948 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:55.310189 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:55.310384 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.310389 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.311132 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.311134 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.312468 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.312472 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.312997 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.312998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.313103 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.313617 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:55.313628 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:55.315481 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:55.317215 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.317222 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.317225 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.317507 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.317723 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.317723 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.317724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.317822 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.318130 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:55.318137 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:55.318265 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 10:06:55.318373 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 10:06:55.318521 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":111,"threads_started":1}
I20260811 10:06:55.319628 2659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:55.320832 2488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } attempt: 2
I20260811 10:06:55.321025 2663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.311551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47514 (local address 127.9.127.252:41145)
0811 10:06:55.311704 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.311713 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.311730 (+ 17us) server_negotiation.cc:407] Connection header received
0811 10:06:55.311804 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.311806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.311822 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.311886 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.312631 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.313563 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.314608 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.315099 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.315192 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.317912 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.317937 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.317937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.317944 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.319727 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.320125 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.320128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.320128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.320192 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.320376 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.320377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.320377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.320563 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.320668 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.320826 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.320903 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":100,"threads_started":1}
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442814, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.254@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:06:55.327301 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.319951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52512 (local address 127.9.127.253:35337)
0811 10:06:55.320008 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.320010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.320020 (+ 10us) server_negotiation.cc:407] Connection header received
0811 10:06:55.320047 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.320048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.320060 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.320108 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.320437 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.321142 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.321988 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.322289 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.322351 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.324125 (+ 1774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.324126 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.324126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.324134 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.325577 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.326194 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.326195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.326196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.326259 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.326693 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.326694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.326694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.326843 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.326929 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.327095 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.327171 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 10:06:55.327311 2661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.319874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.253:35337 (local address 127.0.0.1:52512)
0811 10:06:55.319928 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.319941 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:55.319983 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:55.320125 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:55.320126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:55.320278 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:55.320313 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.320314 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.321227 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.321227 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.321901 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.321904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.322368 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.322369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.322414 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.322765 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:55.322771 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:55.324015 (+ 1244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:55.325880 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.325881 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.325882 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.326084 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.326335 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.326336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.326336 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.326412 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.326926 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:55.326927 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:55.326975 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 10:06:55.327057 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 10:06:55.327178 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.254@KRBTEST.COM
I20260811 10:06:55.327708 2659 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } has no permanent_uuid. Determining permanent_uuid...
I20260811 10:06:55.329221 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.321059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47518)
0811 10:06:55.321311 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.321323 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:55.321370 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:55.321514 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:55.321515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:55.321681 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:55.321727 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.321730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.322766 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.322766 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.323328 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.323330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.323811 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.323811 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.323860 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.324258 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:55.324263 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:55.325574 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:55.327857 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.327857 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.327858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.328134 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.328539 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.328540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.328540 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.328609 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.328923 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:55.328924 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:55.328978 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 10:06:55.329053 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 10:06:55.329159 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229}
I20260811 10:06:55.329267 2663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.321129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47518 (local address 127.9.127.252:41145)
0811 10:06:55.321161 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.321163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.321358 (+ 195us) server_negotiation.cc:407] Connection header received
0811 10:06:55.321421 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.321422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.321434 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.321805 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.321833 (+ 28us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.322510 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.323421 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.323720 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.324033 (+ 313us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.325656 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.325657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.325658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.325664 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.327546 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.328379 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.328379 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.328380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.328449 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.328674 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.328675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.328676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.328847 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.328938 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.329080 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.329186 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 10:06:55.331030 2488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89: Bootstrap starting.
I20260811 10:06:55.331171 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.322040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44124 (local address 127.9.127.254:42369)
0811 10:06:55.322072 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.322074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.322475 (+ 401us) server_negotiation.cc:407] Connection header received
0811 10:06:55.322504 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.322505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.322516 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.322569 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.323193 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.323857 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.324811 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.325068 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.325137 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.328065 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.328067 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.328067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.328074 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.330000 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.330344 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.330345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.330345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.330405 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.330631 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.330631 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.330632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.330770 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.330903 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.330986 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.331075 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 10:06:55.331954 2488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:55.332327 2488 log.cc:824] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89: Log is configured to *not* fsync() on all Append() calls
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.252@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:06:55.333232 2488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89: No bootstrap required, opened a new log
I20260811 10:06:55.335191 2488 raft_consensus.cc:348] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } }
I20260811 10:06:55.335297 2488 raft_consensus.cc:729] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 540d28cd277b45d8be7a30cefa015f89, State: Initialized, Role: FOLLOWER
I20260811 10:06:55.335350 2488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } }
I20260811 10:06:55.335680 2488 sys_catalog.cc:564] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:55.336020 2666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.336112 2666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.9.127.253@KRBTEST.COM
I20260811 10:06:55.337126 2664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.328204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47524 (local address 127.9.127.252:41145)
0811 10:06:55.328365 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.328367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.328373 (+ 6us) server_negotiation.cc:407] Connection header received
0811 10:06:55.328417 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.328418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.328428 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.328494 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.329039 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.330190 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.330994 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.331327 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.331383 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.333480 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.333482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.333482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.333489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.335434 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.335820 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.335821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.335821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.335883 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.336102 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.336103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.336103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.336311 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.336379 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.336914 (+ 535us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.336992 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":115,"threads_started":1}
I20260811 10:06:55.337483 2661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.327993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47524)
0811 10:06:55.328026 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.328037 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:55.328078 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:55.328744 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:55.328745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:55.328940 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:55.328972 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.328974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.330277 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.330278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.330918 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.330920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.331434 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.331435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.331500 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.331984 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:55.331989 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:55.333388 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:55.335528 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.335529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.335530 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.335738 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.335951 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.335952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.335952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.336021 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.336517 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:55.336518 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:55.336567 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 10:06:55.336647 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 10:06:55.336731 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 10:06:55.337916 2678 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:55.337970 2678 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:55.339098 2659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53: Bootstrap starting.
I20260811 10:06:55.339779 2659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:55.340073 2659 log.cc:824] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:55.341048 2659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53: No bootstrap required, opened a new log
I20260811 10:06:55.338768 2415 master_runner.cc:186] Error getting master registration for 127.9.127.253:35337: OK, instance_id { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" instance_seqno: 1786442815134600 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 10:06:55.341589 2415 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 10:06:55.341648 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.331971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52522 (local address 127.9.127.253:35337)
0811 10:06:55.332007 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.332009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.332018 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:06:55.332148 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.332149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.332160 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.332222 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.332871 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.333465 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.334401 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.334638 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.334708 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.337423 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.337424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.337425 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.337432 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.339342 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.340618 (+ 1276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.340619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.340619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.340682 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.340923 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.340924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.340924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.341054 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.341179 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.341465 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.341544 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 10:06:55.343016 2659 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } }
I20260811 10:06:55.343154 2659 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4106d87cb6bf497daf757d577e4f9b53, State: Initialized, Role: FOLLOWER
I20260811 10:06:55.343242 2659 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } }
I20260811 10:06:55.343351 9727 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 10:06:55.343538 2659 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:55.344285 2462 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "540d28cd277b45d8be7a30cefa015f89"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44124
I20260811 10:06:55.344434 2462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 10:06:55.344480 2462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:55.345371 2462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } }
I20260811 10:06:55.345615 2462 leader_election.cc:288] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [CANDIDATE]: Term 1 election: Requested vote from peers aa0e5614b80d44edbd639f788ac8a170 (127.9.127.253:35337), 4106d87cb6bf497daf757d577e4f9b53 (127.9.127.252:41145)
W20260811 10:06:55.345638 2693 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 10:06:55.346590 2693 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:55.346261 2632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "540d28cd277b45d8be7a30cefa015f89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4106d87cb6bf497daf757d577e4f9b53"
I20260811 10:06:55.347308 2632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:55.348150 2632 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 540d28cd277b45d8be7a30cefa015f89 in term 1.
I20260811 10:06:55.348340 2438 leader_election.cc:302] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4106d87cb6bf497daf757d577e4f9b53, 540d28cd277b45d8be7a30cefa015f89; no voters:
I20260811 10:06:55.348475 2666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 10:06:55.348654 2666 raft_consensus.cc:686] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [term 1 LEADER]: Becoming Leader. State: Replica: 540d28cd277b45d8be7a30cefa015f89, State: Running, Role: LEADER
I20260811 10:06:55.348758 2666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } }
I20260811 10:06:55.349267 2695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 540d28cd277b45d8be7a30cefa015f89. Latest consensus state: current_term: 1 leader_uuid: "540d28cd277b45d8be7a30cefa015f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.349496 2695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:55.350495 2681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.350585 2681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:55.350085 2583 master_runner.cc:186] Error getting master registration for 127.9.127.253:35337: OK, instance_id { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" instance_seqno: 1786442815134600 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 10:06:55.352298 2583 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 10:06:55.358925 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.349656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52536 (local address 127.9.127.253:35337)
0811 10:06:55.349705 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.349707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.350743 (+ 1036us) server_negotiation.cc:407] Connection header received
0811 10:06:55.350842 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.350843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.350853 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.350883 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.351646 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.352349 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.353447 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.353748 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.353827 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.355323 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.355325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.355325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.355334 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.357115 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.357606 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.357608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.357608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.357671 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.357919 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.357920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.357920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.358059 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.358530 (+ 471us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.358741 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.358813 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 10:06:55.365345 2664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.349895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47540 (local address 127.9.127.252:41145)
0811 10:06:55.349943 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.349946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.357009 (+ 7063us) server_negotiation.cc:407] Connection header received
0811 10:06:55.357107 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.357108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.357121 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.357179 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.358281 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.359006 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.360533 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.360868 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.360908 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.362351 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.362353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.362353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.362360 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.364049 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.364427 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.364428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.364428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.364480 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.364677 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.364678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.364678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.364837 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.364952 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.365186 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.365267 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 10:06:55.365180 2701 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 10:06:55.366322 2701 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 10:06:55.368026 2632 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [term 1 FOLLOWER]: Refusing update from remote peer 540d28cd277b45d8be7a30cefa015f89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:55.368356 2695 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:55.369957 2681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 540d28cd277b45d8be7a30cefa015f89. Latest consensus state: current_term: 1 leader_uuid: "540d28cd277b45d8be7a30cefa015f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.370047 2681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:55.371093 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.350269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44138 (local address 127.9.127.254:42369)
0811 10:06:55.350305 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.350307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.357200 (+ 6893us) server_negotiation.cc:407] Connection header received
0811 10:06:55.357307 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.357308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.357320 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.357351 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.358113 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.358824 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.359882 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.360164 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.360228 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.366148 (+ 5920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.366149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.366149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.366156 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.367725 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.368709 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.368710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.368710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.368797 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.370291 (+ 1494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.370292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.370292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.370456 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.370536 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.370931 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.371004 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 10:06:55.371093 2575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } attempt: 3
Aug 11 10:06:55 dist-test-slave-1x4g krb5kdc[2400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786442815, etypes {rep=17 tkt=17 ses=17}, kudu/127.9.127.253@KRBTEST.COM for kudu/127.9.127.252@KRBTEST.COM
I20260811 10:06:55.380147 2578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.371564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.127.252:41145 (local address 127.0.0.1:47546)
0811 10:06:55.371746 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 10:06:55.371756 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 10:06:55.371794 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 10:06:55.372100 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 10:06:55.372101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 10:06:55.372256 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 10:06:55.372296 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.372298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.373765 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.373766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.374556 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 10:06:55.374559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.375308 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.375309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 10:06:55.375368 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.375745 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 10:06:55.375750 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 10:06:55.377237 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 10:06:55.379068 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.379069 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.379069 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.379279 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.379478 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 10:06:55.379479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 10:06:55.379480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 10:06:55.379539 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 10:06:55.379811 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 10:06:55.379811 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 10:06:55.379855 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 10:06:55.379942 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 10:06:55.380042 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260811 10:06:55.380505 2664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:55.371753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47546 (local address 127.9.127.252:41145)
0811 10:06:55.371980 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.371982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.371988 (+ 6us) server_negotiation.cc:407] Connection header received
0811 10:06:55.372006 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.372006 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.372014 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.372060 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.372370 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.373097 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.374888 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:55.375200 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:55.375258 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:55.377332 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 10:06:55.377333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 10:06:55.377333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 10:06:55.377340 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 10:06:55.378974 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.379357 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.379358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.379358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.379411 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 10:06:55.379602 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 10:06:55.379603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 10:06:55.379603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 10:06:55.379728 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 10:06:55.379784 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:55.380344 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 10:06:55.380418 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208}
I20260811 10:06:55.381362 2666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "540d28cd277b45d8be7a30cefa015f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.381491 2666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:55.381631 2681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "540d28cd277b45d8be7a30cefa015f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.381702 2681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:55.382153 2575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170: Bootstrap starting.
I20260811 10:06:55.382675 2707 mvcc.cc:205] Tried to move back new op lower bound from 7317269771744837632 to 7317269771669417984. Current Snapshot: MvccSnapshot[applied={T|T < 7317269771744837632}]
I20260811 10:06:55.382906 2575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170: Neither blocks nor log segments found. Creating new log.
I20260811 10:06:55.383208 2575 log.cc:824] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170: Log is configured to *not* fsync() on all Append() calls
I20260811 10:06:55.383773 2706 mvcc.cc:205] Tried to move back new op lower bound from 7317269771744837632 to 7317269771669417984. Current Snapshot: MvccSnapshot[applied={T|T < 7317269771744837632}]
I20260811 10:06:55.384024 2575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170: No bootstrap required, opened a new log
I20260811 10:06:55.386865 2575 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } }
I20260811 10:06:55.387017 2575 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0e5614b80d44edbd639f788ac8a170, State: Initialized, Role: FOLLOWER
I20260811 10:06:55.387097 2575 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } }
I20260811 10:06:55.387420 2575 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 10:06:55.387456 2546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "540d28cd277b45d8be7a30cefa015f89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "aa0e5614b80d44edbd639f788ac8a170"
I20260811 10:06:55.387575 2546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [term 0 FOLLOWER]: Advancing to term 1
I20260811 10:06:55.388433 2546 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 540d28cd277b45d8be7a30cefa015f89 in term 1.
I20260811 10:06:55.388633 2545 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [term 1 FOLLOWER]: Refusing update from remote peer 540d28cd277b45d8be7a30cefa015f89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 10:06:55.389144 2695 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 10:06:55.389235 2701 catalog_manager.cc:1347] Generated new cluster ID: 8ef1780ea8c742e1964c6866214d4cd1
I20260811 10:06:55.389290 2701 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 10:06:55.389564 2712 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.393148 2712 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:55.390503 2727 mvcc.cc:205] Tried to move back new op lower bound from 7317269771744837632 to 7317269771669417984. Current Snapshot: MvccSnapshot[applied={T|T < 7317269771744837632}]
I20260811 10:06:55.395835 2712 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 540d28cd277b45d8be7a30cefa015f89. Latest consensus state: current_term: 1 leader_uuid: "540d28cd277b45d8be7a30cefa015f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.395922 2712 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:55.395961 2712 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "540d28cd277b45d8be7a30cefa015f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.396006 2712 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 10:06:55.401675 2725 catalog_manager.cc:1259] Loaded cluster ID: 8ef1780ea8c742e1964c6866214d4cd1
I20260811 10:06:55.401727 2725 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170: loading cluster ID for follower catalog manager: success
W20260811 10:06:55.401813 2725 catalog_manager.cc:1576] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260811 10:06:55.401852 2725 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260811 10:06:55.403471 2695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "540d28cd277b45d8be7a30cefa015f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "540d28cd277b45d8be7a30cefa015f89" member_type: VOTER last_known_addr { host: "127.9.127.254" port: 42369 } } peers { permanent_uuid: "aa0e5614b80d44edbd639f788ac8a170" member_type: VOTER last_known_addr { host: "127.9.127.253" port: 35337 } } peers { permanent_uuid: "4106d87cb6bf497daf757d577e4f9b53" member_type: VOTER last_known_addr { host: "127.9.127.252" port: 41145 } } }
I20260811 10:06:55.403569 2695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89 [sys.catalog]: This master's current role is: LEADER
I20260811 10:06:55.404443 2701 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 10:06:55.405200 2701 catalog_manager.cc:1504] Loading token signing keys...
I20260811 10:06:55.410800 2701 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 540d28cd277b45d8be7a30cefa015f89: Generated new TSK 0
I20260811 10:06:55.410988 2701 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 10:06:55.438737 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.436951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52538 (local address 127.9.127.253:35337)
0811 10:06:55.437007 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.437009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.438033 (+ 1024us) server_negotiation.cc:407] Connection header received
0811 10:06:55.438155 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.438156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.438168 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.438198 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.438666 (+ 468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52538: BlockingRecv error: recv got EOF from 127.0.0.1:52538 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260811 10:06:55.439533 2664 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.437336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.9.127.252:41145)
0811 10:06:55.437387 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.437389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.438959 (+ 1570us) server_negotiation.cc:407] Connection header received
0811 10:06:55.439065 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.439066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.439077 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.439105 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.439470 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47562: BlockingRecv error: recv got EOF from 127.0.0.1:47562 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 10:06:55.440260 2492 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.437742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44148 (local address 127.9.127.254:42369)
0811 10:06:55.437796 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.437799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.439772 (+ 1973us) server_negotiation.cc:407] Connection header received
0811 10:06:55.439844 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.439845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.439858 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.439935 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.440196 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44148: BlockingRecv error: recv got EOF from 127.0.0.1:44148 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 10:06:55.442375 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.441583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.9.127.253:35337)
0811 10:06:55.441642 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.441644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.441856 (+ 212us) server_negotiation.cc:407] Connection header received
0811 10:06:55.441962 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.441963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.441994 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.442023 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.442330 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52540: BlockingRecv error: recv got EOF from 127.0.0.1:52540 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 10:06:55.445513 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.444727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52552 (local address 127.9.127.253:35337)
0811 10:06:55.444760 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.444762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.445010 (+ 248us) server_negotiation.cc:407] Connection header received
0811 10:06:55.445109 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.445110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.445120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.445160 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.445470 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52552: BlockingRecv error: recv got EOF from 127.0.0.1:52552 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 10:06:55.449450 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.448671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52556 (local address 127.9.127.253:35337)
0811 10:06:55.448708 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.448711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.448961 (+ 250us) server_negotiation.cc:407] Connection header received
0811 10:06:55.449072 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.449073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.449084 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.449111 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.449409 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52556: BlockingRecv error: recv got EOF from 127.0.0.1:52556 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 10:06:55.455694 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.454816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52566 (local address 127.9.127.253:35337)
0811 10:06:55.454851 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.454853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.455159 (+ 306us) server_negotiation.cc:407] Connection header received
0811 10:06:55.455264 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.455265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.455278 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.455308 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.455650 (+ 342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52566: BlockingRecv error: recv got EOF from 127.0.0.1:52566 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 10:06:55.465940 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.464956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52574 (local address 127.9.127.253:35337)
0811 10:06:55.465008 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.465010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.465325 (+ 315us) server_negotiation.cc:407] Connection header received
0811 10:06:55.465434 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.465435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.465447 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.465480 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.465879 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52574: BlockingRecv error: recv got EOF from 127.0.0.1:52574 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 10:06:55.484692 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.483539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52580 (local address 127.9.127.253:35337)
0811 10:06:55.483593 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.483595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.483971 (+ 376us) server_negotiation.cc:407] Connection header received
0811 10:06:55.484114 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.484115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.484130 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.484167 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.484625 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52580: BlockingRecv error: recv got EOF from 127.0.0.1:52580 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 10:06:55.519385 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.518281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52582 (local address 127.9.127.253:35337)
0811 10:06:55.518332 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.518335 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.518661 (+ 326us) server_negotiation.cc:407] Connection header received
0811 10:06:55.518779 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.518780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.518793 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.518827 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.519314 (+ 487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52582: BlockingRecv error: recv got EOF from 127.0.0.1:52582 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 10:06:55.585726 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.584950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52594 (local address 127.9.127.253:35337)
0811 10:06:55.585019 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.585022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.585154 (+ 132us) server_negotiation.cc:407] Connection header received
0811 10:06:55.585210 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.585210 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.585222 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.585276 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.585659 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52594: BlockingRecv error: recv got EOF from 127.0.0.1:52594 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 10:06:55.715803 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.714994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52598 (local address 127.9.127.253:35337)
0811 10:06:55.715090 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.715093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.715201 (+ 108us) server_negotiation.cc:407] Connection header received
0811 10:06:55.715298 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.715299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.715313 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.715361 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.715734 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52598: BlockingRecv error: recv got EOF from 127.0.0.1:52598 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 10:06:55.973748 2580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 10:06:55.973023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52612 (local address 127.9.127.253:35337)
0811 10:06:55.973103 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:55.973106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:55.973158 (+ 52us) server_negotiation.cc:407] Connection header received
0811 10:06:55.973237 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:55.973238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:55.973249 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:55.973329 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 10:06:55.973680 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52612: BlockingRecv error: recv got EOF from 127.0.0.1:52612 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 10:06:56.347101 2693 catalog_manager.cc:1259] Loaded cluster ID: 8ef1780ea8c742e1964c6866214d4cd1
I20260811 10:06:56.347183 2693 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53: loading cluster ID for follower catalog manager: success
I20260811 10:06:56.348029 2693 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53: acquiring CA information for follower catalog manager: success
I20260811 10:06:56.348354 2693 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4106d87cb6bf497daf757d577e4f9b53: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 10:06:56.402982 2725 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170: acquiring CA information for follower catalog manager: success
I20260811 10:06:56.403296 2725 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aa0e5614b80d44edbd639f788ac8a170: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 10:06:56.489921 2802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:56.487132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52624 (local address 127.9.127.253:35337)
0811 10:06:56.487263 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:56.487266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:56.487322 (+ 56us) server_negotiation.cc:407] Connection header received
0811 10:06:56.487436 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:56.487437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:56.487499 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:56.487583 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:56.487761 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.488321 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.489196 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.489414 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.489470 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:56.489591 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:56.489700 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:56.489756 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:56.489788 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 10:06:56.489805 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260811 10:06:56.494197 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:56.491714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47564 (local address 127.9.127.252:41145)
0811 10:06:56.491836 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:56.491839 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:56.491848 (+ 9us) server_negotiation.cc:407] Connection header received
0811 10:06:56.491918 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:56.491919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:56.491960 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:56.492054 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:56.492151 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.492631 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.493400 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.493621 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.493717 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:56.493858 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:56.493956 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:56.494042 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:56.494087 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 10:06:56.494108 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":54,"threads_started":1}
I20260811 10:06:56.498634 2802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:56.495759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52636 (local address 127.9.127.253:35337)
0811 10:06:56.495799 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:56.495801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:56.495984 (+ 183us) server_negotiation.cc:407] Connection header received
0811 10:06:56.496038 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:56.496039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:56.496051 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:56.496098 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:56.496276 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.497025 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.497910 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.498114 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.498195 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:56.498398 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:56.498431 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:56.498491 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:56.498542 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 10:06:56.498563 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 10:06:56.499135 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:56.496090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47578 (local address 127.9.127.252:41145)
0811 10:06:56.496151 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:56.496153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:56.496273 (+ 120us) server_negotiation.cc:407] Connection header received
0811 10:06:56.496382 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:56.496383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:56.496393 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:56.496458 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:56.496561 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.497084 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.498320 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.498595 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.498661 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:56.498849 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:56.498879 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:56.498910 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:56.499024 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 10:06:56.499047 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 10:06:56.499365 2815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 10:06:56.495781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44160 (local address 127.9.127.254:42369)
0811 10:06:56.495888 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 10:06:56.495890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 10:06:56.495940 (+ 50us) server_negotiation.cc:407] Connection header received
0811 10:06:56.496058 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 10:06:56.496059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 10:06:56.496111 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 10:06:56.496194 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 10:06:56.496341 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.497112 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.498331 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 10:06:56.498626 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 10:06:56.498687 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 10:06:56.498931 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 10:06:56.499055 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 10:06:56.499110 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 10:06:56.499224 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 10:06:56.499258 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":54,"threads_started":1}
I20260811 10:06:56.500880 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 2415
I20260811 10:06:56.511467 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 2496
I20260811 10:06:56.518580 9727 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskwRyaEw/build/release/bin/kudu with pid 2583
2026-08-11T10:06:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2884 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5750 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (273053 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST